Azure Databricks Engineer

15 hours ago

Others, India Neev Systems Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Description :

Azure Data Bricks SQL. Azure Data Bricks SQL. by HR Neev Systems.

Experience : 5 Years.

Location : Hyderabad.


Job Description :

We are seeking an experienced Azure Databricks SQL Developer / Big Data Engineer to design, develop, and maintain scalable data solutions on Azure. The role will focus on building efficient ETL/ELT pipelines, optimizing SQL queries, and leveraging Databricks and other Azure services for advanced data processing, analytics, and data platform engineering. The ideal candidate will have a strong background in both traditional SQL development and modern big data technologies on Azure.

Key Responsibilities :

- Develop, maintain, and optimize ETL/ELT pipelines using Azure Databricks (PySpark/Spark SQL).

- Write and optimize complex SQL queries, stored procedures, triggers, and functions in

Microsoft SQL Server.

- Design and build scalable, metadata-driven ingestion pipelines for both batch and streaming datasets.

- Perform data integration and harmonization across multiple structured and unstructured data sources.

- Implement orchestration, scheduling, exception handling, and log monitoring for robust pipeline management.

- Collaborate with peers to evaluate and select appropriate tech stack and tools.

- Work closely with business, consulting, data science, and application development teams to

deliver analytical solutions within timelines.

- Support performance tuning, troubleshooting, and debugging of Databricks jobs and SQL queries.

- Work with other Azure services such as Azure Data Factory, Azure Data Lake, Synapse

Analytics, Event Hub, Cosmos DB, Streaming Analytics, and Purview when required.

- Support BI and Data Science teams in consuming data securely and in compliance with

governance standards.


Required Skills & Experience :

years of overall IT experience with at least 4 years in Big Data Engineering on Microsoft

Azure.

- Proficiency in Microsoft SQL Server (T-SQL) stored procedures, indexing, optimization, and performance tuning.

- Strong experience with Azure Data Factory (ADF), Databricks, ADLS, PySpark, and Azure SQL Database.

- Working knowledge of Azure Synapse Analytics, Event Hub, Streaming Analytics, Cosmos DB,

and Purview.

- Proficiency in SQL, Python, and either Scala or Java with debugging and performance

optimization skills.

- Hands-on experience with big data technologies such as Hadoop, Spark, Airflow, NiFi, Kafka,

Hive, Neo4J, and Elastic Search.

- Strong understanding of file formats such as Delta Lake, Avro, Parquet, JSON, and CSV.

- Solid background in data modeling, data transformation, and data governance best practices.

- Experience designing and building REST APIs with practical exposure to Data Lake or

Lakehouse projects.

- Ability to work with large and complex datasets, ensuring data quality, governance, and

security standards.

- Certifications such as DP-203 : Data Engineering on Microsoft Azure or Databricks Certified

Developer (DE) are a plus.

  • Azure Data Engineer

    14 hours ago

    Others, India Vikash Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description:About the Opportunity : We are seeking an experienced Azure Data Engineer to design and implement large-scale, cloud-based data solutions leveraging the Microsoft Azure ecosystem. This role is ideal for a data professional with deep expertise in ETL/ELT pipelines, Spark-based processing, and data modeling, who can architect robust, scalable...

  • Senior Data Engineer

    4 days ago

    Others, India ResourceTree Global Services Pvt Ltd Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Name : Senior Data Engineer Azure Years of Experience : 5 Job Description : We are looking for a skilled and experienced Senior Azure Developer to join our team As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company. If you love learning, thinking strategically, innovating, and helping others,...

  • i2k2 - Azure DevOps Engineer - Linux/Windows OS

    5 days ago

    Others, India I2K2 Networks (P) Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position : Azure DevOps Engineer Experience : 2 to 5 Years Must Have : Strong in-hand experience in Azure, DevOps, Linux, Windows, Active Directory, IIS, etc. Location : Noida Sector 63 (Work From Office) Working Days : 5 Notice Period : LOOKING FOR IMMEDIATE TO 15 DAYS JOINERS. Job Description : A technical L2 role wherein a...

  • Softobiz - Data Engineer - Synapse Analytics

    15 hours ago

    Others, India softobiz technologies Pvt ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Job Title : Data Engineer. Experience : 8 years. Career-defining role available with Tier 1 Blue Chip Australian Client. As a Data Engineer, you will be involved in all phases of the software development life cycle, collecting and documenting business requirements, prototyping solutions, development, deployment, and ongoing...

  • Lead Data Engineer

    5 days ago

    Others, India ResourceTree Global Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Name : Lead Data Engineer - AWS RedShift Years of Experience : 8 Job Description : We are seeking a highly skilled and motivated Lead Data Engineer to join our Data Integration and Analytics team. The ideal candidate will bring deep expertise in AWS Redshift, with strong knowledge of Redshift architecture, query performance tuning, and workload...

  • Senior Data Engineer

    3 days ago

    Others, India ResourceTree Global Services Pvt Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Years of Experience : 6 Job Description : We are seeking an experienced and detail-oriented Senior Data Engineer with strong expertise in QA process automation for data validation and testing. The ideal candidate will bring hands-on experience with QuerySurge and a solid foundation in ETL/ELT processes, data integration, and data quality assurance. In this...

  • Senior Software Engineer

    2 weeks ago

    Others, India Pylon Management Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Sr. Software Engineer - .NET C# (Drive) Key Responsibilities : - Design, develop, and maintain applications using .NET Core, C#, Web API, MVC, Entity Framework, and LINQ. - Build and integrate solutions leveraging Generative AI (LLMs, NLP, prompt engineering, API integrations). - Implement AI/ML capabilities using Azure AI/ML, Cognitive Services,...

  • Migration Engineer

    16 hours ago

    Others, India TALENT CARPET HR SOLUTIONS Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Description : Position Summary : We are looking for an experienced Migration Engineer to execute infrastructure, application, and database migrations to Azure and AWS. The role requires strong hands-on expertise with migration tools, hybrid/cloud environments, and the ability to deliver migrations with minimal downtime, while maintaining security and...

  • Software Development Engineer

    2 weeks ago

    Others, India Pylon Management Consulting Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities : - Design, develop, and maintain automated test frameworks for cloud-native applications running on AKS. - Build and execute integration, functional, regression, performance, and scalability tests. - Work closely with development and DevOps teams to integrate automated tests into CI/CD pipelines. - Validate deployments,...

  • Software Engineer

    14 hours ago

    Others, India zyoin Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : Requirements : - Significant experience working on backend systems. - Excited about working in the big data space. - Relevant experience developing software in either Python, Go, or other object-oriented languages. - Comprehensive experience in software development, integrating with RESTful API interfaces. - Experience with either SQL...