Azure Data Engineer
1 day ago
Azure Databricks
Role Overview:
We are seeking a highly skilled Azure Databricks Developer with relevant years of experience in Azure Cloud services and hands-on expertise with Databricks, Azure data factory,ADB, Python, and PySpark. The ideal candidate will be responsible for designing, implementing, and optimizing data processing pipelines and will play a critical role in our data engineering projects.
Key Responsibilities:
Data Engineering:
- Design, develop, and optimize large-scale data processing pipelines using Azure Databricks, Azure data factory,etc.
- Implement complex data transformations and processing workflows with PySpark.
- Develop and maintain scalable data architecture and pipelines to support various data projects.
Azure Cloud Services:
- Utilize various Azure services such as Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics to build end-to-end data solutions.
- Monitor, troubleshoot, and optimize Azure cloud resources and Databricks clusters for performance and cost-efficiency.
Data Integration:
- Integrate data from multiple sources and ensure data consistency and integrity.
- Develop and implement data validation and quality checks.
Collaboration:
- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Participate in agile development processes and contribute to continuous improvement practices.
Documentation and Reporting:
- Document data workflows, architecture, and processes for knowledge sharing and maintenance.
- Generate reports and visualizations to communicate insights and progress to stakeholders.
Required Skills and Experience:
Technical Skills:
- Strong experience with Azure Databricks , Azure data factory,etc and PySpark.
- Proficiency in Python programming, with a focus on data processing and manipulation.
- Experience with Azure services such as Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics.
- Solid understanding of data warehousing concepts and ETL processes.
- Familiarity with CI/CD practices and tools for data pipelines.
Professional Experience:
- Rel years of hands-on experience in data engineering and cloud-based data processing.
- Proven track record of working with large-scale data systems and distributed computing.
- Experience in performance tuning and optimization of data processing jobs.
Soft Skills:
- Excellent problem-solving skills and attention to detail.
- Strong communication skills to collaborate effectively with cross-functional teams.
- Ability to work independently and manage multiple tasks in a dynamic environment.
-
Azure Data Engineer
1 week ago
Chennai, Tamil Nadu, India D2KSS SOFTWARE SERVICES PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 24,00,000 per yearIndustry & Sector:IT services and enterprise data engineering — delivering cloud-native analytics, ETL/ELT pipelines, and modern data platform implementations on Microsoft Azure for large enterprise customers. This is an on-site, hands-on engineering role supporting strategic data modernization initiatives across business domains.Primary Job TitleSenior...
-
Azure Data engineer
5 days ago
Chennai, Tamil Nadu, India viraaj hr solutions Full time ₹ 2,64,000 - ₹ 3,96,000 per yearPrimary Title: Azure Data EngineerAbout the OpportunityA leading firm in Cloud Data & Analytics and IT Services, focused on designing, implementing, and operating cloud-native data platforms on Microsoft Azure for enterprise customers. We build scalable ETL/ELT pipelines, data lakes, and analytics solutions that drive insights and operational decisioning...
-
Data Engineer
6 days ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 9,00,000 - ₹ 12,00,000 per yearHiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...
-
Azure Data engineer
3 days ago
Chennai, Tamil Nadu, India Arizon Digital USA - Digital Commerce Experts Full time ₹ 9,00,000 - ₹ 12,00,000 per yearCompany DescriptionArizon Digital is a one-stop shop for e-commerce, enabling organizations to develop and optimize e-commerce sites efficiently. We help businesses choose the right technology, platforms, and processes to achieve success. With our cross-industry knowledge and technological expertise, we create customized solutions that meet all success...
-
Data Engineer(Azure)
6 days ago
Chennai, Tamil Nadu, India Photon Group Full time ₹ 6,00,000 - ₹ 18,00,000 per yearDescription Greetings EveryoneWho are we? For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check What will you do? What are...
-
Data Engineer
6 days ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...
-
Azure Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per yearYears of Experience: 5Job Description: We are seeking a skilled and experienced Senior Azure Developer to join our team As part of the team, you will be involved in implementing ongoing and new initiatives for our company. If you love learning, thinking strategically, innovating,and helping others, this job is for youPrimary Skills: ADF,DatabricksSecondary...
-
Azure Data Engineer
5 days ago
Chennai, Tamil Nadu, India DataEngine Full time ₹ 12,00,000 - ₹ 36,00,000 per yearHiring for Azure Data EngineerExperience: 8+ yearsLocation: Chennai, Hyderabad, BangaloreNotice Period: Immediate to 30 daysKey ResponsibilitiesData Pipelines: Build pipelines for raw data ingestion and orchestration using Azure Data Factory (ADF) and DatabricksData Transformation: Develop and maintain innovative Azure solutions, perform transformation using...
-
Azure Data Engineer
6 days ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 8,00,000 - ₹ 24,00,000 per yearGreetingsTCS is hiring...Weekend Walk-in-InterviewDAte- 29- Nov-25(Saturday)Role:Azure Data EngineerEXP: 5- 10 YEARSLOCATION: ChennaiJob Description3+ years of relevant experience in Pyspark and Azure Synapse Analytics/Azure Databricks. •Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources....
-
Senior Data Engineer – Azure
2 weeks ago
Chennai, Tamil Nadu, India Systech Full time ₹ 20,00,000 - ₹ 25,00,000 per yearSenior Data Engineer – AzureAbout the CompanySystech is a modern Data and Analytics consulting firm, helping clients embed data-driven capabilities into their business operations. We offer end-to-end data engineering services and outcomes-based analytics solutions, to drive your business forward in the digital age. Systech has over 30 years of experience,...