PinnedNidhi GuptaExploring PySpark Setup in Visual Studio CodeThis article provides a step-by-step guide to setting up your environment, leveraging the robust capabilities of PySpark, and seamlessly…Dec 16, 2023Dec 16, 2023
PinnedNidhi GuptaSQL Interview QuestionsIn this article, I will be sharing a few SQL interview questions which are commonly asked in SQL interviews.Mar 18, 20233Mar 18, 20233
PinnedNidhi GuptaAzure Data Engineering Interview QuestionsData engineering plays a critical role in the world of data science and analytics.Jul 29, 20231Jul 29, 20231
PinnedNidhi GuptaFrom Preparation to Success: A Roadmap for Passing Databricks Certified Data Engineering AssociateHello!! My medium family this time I am back with an article, sharing my journey from preparation to success for the certificate exam.Oct 14, 2023Oct 14, 2023
PinnedNidhi GuptaAzure Synapse vs Databricks: Choosing the Right Big Data PlatformIn the rapidly evolving landscape of big data analytics, organizations are faced with the challenge of selecting the right platform that…Jan 316Jan 316
Nidhi GuptaExplode vs Explode_outer in DatabricksWorking with JSON data presents a consistent challenge for data engineers. I recently had the opportunity to explore the use cases for…3d ago3d ago
Nidhi GuptaPySpark Schema Strategies: When to Use InferSchema, MergeSchema, and OverwriteSchemaHello, everyone! I’m happy to be back with another article for you. In my recent project, I’ve been focusing on updating the schema of a…Sep 18Sep 18
Nidhi GuptaOptimizing Real-Time Data Pipelines: Streaming Tables vs. Delta Live TablesHello, my readers! Recently, while diving into Databricks, I came across some terminology that piqued my interest and, to be honest, left…Sep 10Sep 10
Nidhi GuptaUnity Catalog Data Governance: From Connections to Delta SharingIn Unity Catalog, options such as Delta Sharing, External Locations, and Connections are integral to the Data Governance Features. These…Aug 31Aug 31
Nidhi GuptaHiveMetastore to Unity Catalog: Evolution of Data ManagementIn today’s data-driven world, effective data management and governance are more critical than ever. As organizations generate and handle…Aug 24Aug 24
