PinnedNidhi GuptaExploring PySpark Setup in Visual Studio CodeThis article provides a step-by-step guide to setting up your environment, leveraging the robust capabilities of PySpark, and seamlessly…Dec 16, 2023Dec 16, 2023
PinnedNidhi GuptaSQL Interview QuestionsIn this article, I will be sharing a few SQL interview questions which are commonly asked in SQL interviews.Mar 18, 20233Mar 18, 20233
PinnedNidhi GuptaAzure Data Engineering Interview QuestionsData engineering plays a critical role in the world of data science and analytics.Jul 29, 20231Jul 29, 20231
PinnedNidhi GuptaFrom Preparation to Success: A Roadmap for Passing Databricks Certified Data Engineering AssociateHello!! My medium family this time I am back with an article, sharing my journey from preparation to success for the certificate exam.Oct 14, 2023Oct 14, 2023
PinnedNidhi GuptaAzure Synapse vs Databricks: Choosing the Right Big Data PlatformIn the rapidly evolving landscape of big data analytics, organizations are faced with the challenge of selecting the right platform that…Jan 316Jan 316
Nidhi GuptaFrom Storage to Analysis: Accessing Azure Data Lake with DatabricksThe article demonstrates how to access an Azure Data Lake Gen2 account using a Databricks Notebook. This is a common use case for data…Nov 1Nov 1
Nidhi GuptaHow important is the order of columns in indexes?Indexes are essential tools for optimizing database queries, but understanding the importance of the order of columns in multi-column…Oct 19Oct 19
Nidhi GuptaWays to Optimize and Improve PostgreSQL PerformancePostgreSQL is a powerful and feature-rich open-source relational database system that can efficiently handle large volumes of data…Oct 19Oct 19
Nidhi GuptaExplode vs Explode_outer in DatabricksWorking with JSON data presents a consistent challenge for data engineers. I recently had the opportunity to explore the use cases for…Oct 2Oct 2
Nidhi GuptaPySpark Schema Strategies: When to Use InferSchema, MergeSchema, and OverwriteSchemaHello, everyone! I’m happy to be back with another article for you. In my recent project, I’ve been focusing on updating the schema of a…Sep 18Sep 18