Develop and maintain ETL/ELT pipelines using Azure Databricks and Spark.
Integrate Databricks with Azure services like Data Lake, Synapse Analytics, Blob Storage, Azure SQL, and Power BI.
Optimize Spark jobs and cluster configurations for performance, scalability, and cost-efficiency.
Collaborate with data scientists, data engineers, and analysts to deploy AI/ML models and analytics solutions.
Ensure data quality, security, and governance compliance.
Monitor, troubleshoot, and improve Azure Databricks clusters and workflows.
Automate workflows and support reporting and visualization.
Azure Databricks Engineers in Tata Group typically receive:
Provident Fund (PF) & Gratuity
Health & Life Insurance
Annual Performance Bonus
Paid Leave & Holidays
Training & Certification Sponsorship (Azure, Databricks, Spark, AI/ML)
Opportunities to work on enterprise-scale cloud analytics and AI projects