test: spark 3.5 changes

[ranadeepsingh]

Based on 99ce8ac#diff-1250fe52790be66c0718296d26be97fdaee7cfca04d0448f5b87dba907dfa669

[ranadeepsingh]

/azp run

[github-actions]

Hey @ranadeepsingh 👋!
Thank you so much for contributing to our repository 🙌.
Someone from SynapseML Team will be reviewing this pull request soon.

We use semantic commit messages to streamline the release process.
Before your pull request can be merged, you should make sure your first commit and PR title start with a semantic prefix.
This helps us to create release messages and credit you for your hard work!

Examples of commit messages with semantic prefixes:

• fix: Fix LightGBM crashes with empty partitions
• feat: Make HTTP on Spark back-offs configurable
• docs: Update Spark Serving usage
• build: Add codecov support
• perf: improve LightGBM memory usage
• refactor: make python code generation rely on classes
• style: Remove nulls from CNTKModel
• test: Add test coverage for CNTKModel

To test your commit locally, please follow our guild on building from source.
Check out the developer guide for additional guidance on testing your change.

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[ranadeepsingh]

/azp run

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[ranadeepsingh]

/azp run

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[codecov-commenter]

Codecov Report

❌ Patch coverage is 87.87879% with 4 lines in your changes missing coverage. Please review.
✅ Project coverage is 84.21%. Comparing base (fc6675d) to head (2c20caf).

Files with missing lines	Patch %	Lines
...rk/sql/types/injections/OptimizedCKNNFitting.scala	71.42%	2 Missing ⚠️
...crosoft/azure/synapse/ml/explainers/LIMEBase.scala	0.00%	1 Missing ⚠️
...crosoft/azure/synapse/ml/io/image/ImageUtils.scala	66.66%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2440      +/-   ##
==========================================
- Coverage   84.46%   84.21%   -0.26%     
==========================================
  Files         334      334              
  Lines       17591    17591              
  Branches     1603     1601       -2     
==========================================
- Hits        14859    14814      -45     
- Misses       2732     2777      +45     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[ShreyashRahinj]

Thanks for this PR — this change is urgently needed for my work. It would be really helpful if it could be merged for the next SynapseML release.

[ranadeepsingh]

Thanks for this PR — this change is urgently needed for my work. It would be really helpful if it could be merged for the next SynapseML release.

Hi @ShreyashRahinj, through a different PR all of SynapseML has been upgraded to be based off Spark 3.5 in the latest v1.1.0.

It's available pre-installed on Microsoft Fabric runtime 1.3 or you may choose to install this library in your own setup.