Databricks Data Engineer with 8 years of experience building scalable Lakehouse solutions using Azure Databricks, Apache Spark, Delta Lake, PySpark, and cloud-native data engineering technologies.
Expertise & skills
Databricks
DatabricksDelta LakeDelta Live TablesUnity CatalogMLflowDatabricks SQL
Big Data
Apache SparkPySparkSpark SQLStructured StreamingKafka
Cloud
Azure Data FactoryADLS Gen2AWS S3AWS Glue
Programming
PythonSQLScala
DevOps
GitAzure DevOpsJenkinsTerraform
Visualization
Power BITableau
Selected projects
Technologies: Azure Databricks, PySpark, Delta Lake, Spark SQL
- Designed scalable ETL pipelines.
- Implemented Delta Lake architecture.
- Optimized Spark workloads.
- Automated deployment and scheduling.
- Improved overall data quality and performance.
Technologies: Azure Databricks, PySpark, Delta Lake, Spark SQL
- Designed scalable ETL pipelines.
- Implemented Delta Lake architecture.
- Optimized Spark workloads.
- Automated deployment and scheduling.
- Improved overall data quality and performance.
Technologies: Azure Databricks, PySpark, Delta Lake, Spark SQL
- Designed scalable ETL pipelines.
- Implemented Delta Lake architecture.
- Optimized Spark workloads.
- Automated deployment and scheduling.
- Improved overall data quality and performance.
Technologies: Azure Databricks, PySpark, Delta Lake, Spark SQL
- Designed scalable ETL pipelines.
- Implemented Delta Lake architecture.
- Optimized Spark workloads.
- Automated deployment and scheduling.
- Improved overall data quality and performance.
Technologies: Azure Databricks, PySpark, Delta Lake, Spark SQL
- Designed scalable ETL pipelines.
- Implemented Delta Lake architecture.
- Optimized Spark workloads.
- Automated deployment and scheduling.
- Improved overall data quality and performance.
Certifications
- Databricks Certified Professional Data Engineer
- Microsoft Azure Data Engineer Associate (DP-203)
Education
Bachelor of Technology (Information Technology)
Achievements
- Delivered 50+ ETL pipelines.
- Improved Spark performance by 48%.
- Processed 100+ TB enterprise data.
- Built reusable CI/CD framework.
- Led enterprise Lakehouse migration.
Similar engineers
Other Data Engineering engineers with comparable experience.
