Cloud Data Engineer with 4 years of experience in Azure Databricks and modern data engineering. Skilled in designing Lakehouse architectures, developing PySpark ETL pipelines, implementing Delta Lake, Databricks Workflows, Unity Catalog, and Azure Data Factory. Experienced in handling large-scale structured and semi-structured data for enterprise analytics and reporting.
Expertise & skills
Cloud
Microsoft Azure
Databricks
DatabricksDelta LakeUnity CatalogDatabricks WorkflowsDelta Live TablesAuto Loader
Programming
PythonPySparkSQL
Big Data
Apache SparkSpark SQL
Azure Services
Azure Data FactoryADLS Gen2Azure Event GridAzure Key Vault
Databases
Azure SQL DatabaseMySQL
DevOps
GitAzure DevOpsCI/CD
Reporting
Power BIAzure Synapse Analytics
Selected projects
Airline Operations Analytics Platform
- Built PySpark pipelines to process flight schedules, passenger, and baggage data.
- Implemented Medallion Architecture using Delta Lake.
- Automated batch processing with Databricks Workflows.
- Optimized Spark jobs using caching, partitioning, and broadcast joins.
- Delivered analytics-ready datasets for operational dashboards.
Real Estate Data Lakehouse
- Integrated CRM, property listings, and customer enquiry data into Azure Databricks.
- Developed reusable ingestion framework using Auto Loader.
- Implemented Unity Catalog for secure data governance.
- Created Gold tables for sales and property performance reporting.
- Supported production releases and performance tuning.
Digital Payments Analytics
- Developed ETL pipelines for payment transaction processing.
- Implemented Delta Live Tables with data quality expectations.
- Created reusable SQL views for finance reporting.
- Performed root cause analysis for production incidents.
- Collaborated with cross-functional teams using Agile methodology.
Certifications
- Databricks Fundamentals
- Microsoft Azure Fundamentals (AZ-900)
- Microsoft Azure Data Fundamentals (DP-900)
Education
Bachelor of Engineering (Computer Engineering)
Silver Oak University
Achievements
- 4 years of Azure Databricks development experience.
- Strong expertise in PySpark, Spark SQL, and Delta Lake.
- Hands-on experience with Delta Live Tables and Unity Catalog.
- Built enterprise-grade ETL pipelines and Lakehouse solutions.
- Experienced in Agile delivery, CI/CD, and production support.
Similar engineers
Other Data Engineering engineers with comparable experience.
