chore(deps): Upgrade pyarrow to 18.1.0

[phillipleblanc]

SUMMARY

Upgrade pyarrow to 18.1.0, to support the StringView arrow type.

TESTING INSTRUCTIONS

Start Superset and verify that the SQL Lab queries are still working.

ADDITIONAL INFORMATION

• Has associated issue: Fixes Update PyArrow dependency to support StringView type #31475
• Required feature flags:
• Changes UI
• Includes DB Migration (follow approval process in SIP-59)
  • Migration is atomic, supports rollback & is backwards-compatible
  • Confirm DB migration upgrade and downgrade tested
  • Runtime estimates and downtime expectations provided
• Introduces new feature or API
• Removes existing feature or API

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 83.75%. Comparing base (76d897e) to head (d451881).
Report is 1218 commits behind head on master.

Additional details and impacted files

@@             Coverage Diff             @@
##           master   #31476       +/-   ##
===========================================
+ Coverage   60.48%   83.75%   +23.26%     
===========================================
  Files        1931      538     -1393     
  Lines       76236    39128    -37108     
  Branches     8568        0     -8568     
===========================================
- Hits        46114    32772    -13342     
+ Misses      28017     6356    -21661     
+ Partials     2105        0     -2105     

Flag	Coverage Δ
hive	48.75% <ø> (-0.41%)	⬇️
javascript	?
mysql	76.51% <ø> (?)
postgres	76.57% <ø> (?)
presto	53.27% <ø> (-0.54%)	⬇️
python	83.75% <ø> (+20.26%)	⬆️
sqlite	76.03% <ø> (?)
unit	60.88% <ø> (+3.25%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[villebro]

LGTM. This is a biiiig bump, fingers crossed this doesn't break anything. But I assume we should have adequate coverage to protect against these types of upgrade regressions.

[villebro]

Changing to "Request changes" to update the dependency bounds.

[phillipleblanc]

@villebro I've updated the dependency bounds

[rusackas]

Running CI 🤞

[villebro]

You need to update requirements/development.txt, too, as that is pinning pyarrow==14.0.2. Optimally, you should run the uv commands for this.

[phillipleblanc]

Thanks, I've run the uv command to update both requirements/base.txt and requirements/development.txt.

[villebro]

LGTM - it appears the docker build step is failing, but I believe it's unrelated. I'll try to restart CI, but it may well be that something needs to be fixed on master before we can get this working..