📝[Docs]: Blog on spark optimization techniques

[Adez017]

Is there an existing issue for this?

• I have searched the existing issues

Issue Description

An end to end complete blog on spark optimization techniques

Suggested Change

NIL

Rationale

No response

Urgency

High

Record

• I have read the Contributing Guidelines
• I want to work on this issue
• I am a part of gssoc26

[github-actions]

Thanks for opening this issue! 🎉 We'll look into it as soon as possible, estimated time for response is 5–8 hrs.

Don't raise PR unless assigned to you.

In the meantime, please provide all necessary details and context to your issue — screenshots or videos of your changes help speed up the review and assignment. If you have questions, reach out to LinkedIn. Your contributions are highly appreciated!😊

Note: I maintain the repo issue every day twice at 8:00 AM IST and 9:00 PM IST. If your issue goes stale for more than one day, you can tag and comment on this same issue by tagging @sanjay-kv.

We are here to help you on this journey of open source. Consistent contributions are eligible for sponsorship 💰

🎁 check our list of amazing people we sponsored so far: GitHub Sponsorship. ✨

📚Resources which can help you know more about Github 👇🏻

1. End to End GitHub Beginner Playlist: GitHub Playlist.

2. Build your GitHub Profile: GitHub Profile Optimisation.

3. GitHub Handbook for dummies: GitHub Blog for Beginners.

[github-actions]

Thanks for opening this issue. To help maintainers review it faster, please add the missing details below:

• Details on the specific topics or techniques to cover in the blog.
• Target audience for the blog post.
• Any specific format or structure desired for the blog.

[sanjay-kv]

Include these subtopics as well
Data Skew and Salting techniques.

Optimizing Shuffles (spark.sql.shuffle.partitions and Adaptive Query Execution).

Broadcast Joins vs. Sort-Merge Joins.

[github-actions]

👤 Issue assigned to @Adez017.