Design and implement data pipelines using Azure Databricks for large-scale data processing.
Integrate Databricks with Azure Data Lake, Azure SQL Database, Blob Storage, and other Azure services.
Optimize Spark jobs and cluster configurations for performance and cost-efficiency.
Collaborate with data scientists, analysts, and engineers to deploy AI/ML and analytics models.
Ensure data quality, security, and governance compliance.
Automate ETL/ELT workflows and data transformations.
Monitor and troubleshoot Databricks jobs and clusters.
Create dashboards and reports using Power BI or other visualization
Azure Databricks Engineers at Tata Group generally receive:
Provident Fund (PF) & Gratuity
Health & Life Insurance
Annual Performance Bonus
Paid Leave & Holidays
Training & Certification Sponsorship (Azure, Databricks, Big Data, AI/ML)
Opportunities to work on enterprise-scale cloud analytics and AI projects