Senior Azure Data Engineer

4 weeks ago


MumbaiBangalore, Maharashtra, India Techno Wise Full time

Responsibilities :

1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.

2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.

3. Optimize and tune existing data pipelines for performance and reliability.

4. Work closely with cloud-based services, particularly Azure or AWS, to deploy and manage data solutions in the cloud environment.

5. Implement data quality and data governance best practices to ensure the accuracy and reliability of the data.

6. Monitor and troubleshoot data pipelines, resolving issues promptly to minimize downtime and data loss.

7. Stay updated with the latest industry trends and technologies related to data engineering, Databricks, PySpark, and cloud platforms.

8. Collaborate with cross-functional teams to integrate data engineering solutions into various applications and systems.

9. Document data engineering processes, architectures, and configurations for reference and knowledge sharing.

10. Provide technical guidance and mentorship to junior data engineers in the team.

Requirements :

Responsibilities :

- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.

- Utilize Databricks for big data analytics and real-time data processing, ensuring optimal performance and efficiency.

- Collaborate with data architects to design and implement effective data models and architectures to support business requirements.

- Implement ETL processes for data extraction, transformation, and loading, ensuring the integrity and quality of the data.

- Integrate data from various sources, ensuring compatibility, accuracy, and adherence to data governance standards.

- Identify and address performance bottlenecks in data pipelines, optimizing for speed, reliability, and scalability.

- Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.

- Conduct code reviews, enforce best practices in coding and documentation, and mentor junior team members.

Education :

- Bachelor's or master's degree in Computer Science, Information Systems, or a related field.

Experience :

- Minimum of 6 years of hands-on experience as a Data Engineer, with a focus on Azure Data Engineering and Databricks.

Technical Skills :

- Proficiency in Azure Data Factory, Azure Databricks, SQL, Python, and ETL processes.

- Solid understanding of data modelling, data warehousing, and big data concepts.

(ref:hirist.tech)

  • Mumbai, Maharashtra, India Firstcareercentre Full time

    Job Brief SummarySenior Azure Data EngineeringTotal Experience : - 5 Years - If candidate is good can take 4+ yrs as wellLocation : Mumbai- Must have 4 Years of Experience on Python- Must have 4 yrs relevant experience on Apache Spark OR PySpark- Must have 5 yrs of experience in SQL [Must be proficient in writing Advanced complex queries ]- Good to have...

  • Team Lead

    4 weeks ago


    Mumbai, Maharashtra, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description :- We are seeking a highly skilled and motivated individual to join our team as a team lead - azure data engineer.- The ideal candidate will have a strong background in azure data technologies, a proven track record of leading data engineering teams, and the ability to design and implement scalable and efficient data solutions.- The team lead...


  • Mumbai, Maharashtra, India Ernst and Young Services Pvt. Ltd Full time

    Azure ETL Engineer/ Data Warehouse Engineer:Position Description: The Azure ETL Engineer will perform hands-on ETL/ELT pipeline development to support a long-term initiative to migrate and transform an existing on-premises Data Management and Analytics solution to Azure.The Azure ETL Engineer will work under the direction of a Team Lead BI Architect to...


  • Mumbai/Pune, Maharashtra, India Techno Wise Full time

    Job Description :1. Design, develop, and deploy cloud-based applications on the Azure platform.2. Utilize Azure Cognitive Services for implementing AI-powered features into applications.3. Develop serverless applications using Azure Functions, particularly leveraging Python programming language.4. Build and deploy static web applications and web applications...


  • Navi Mumbai, Maharashtra, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...

  • Azure Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India ADS247365 Full time

    Location : Mumbai, Maharashtra Duration : Full TimeJob Description :Roles & Responsibilities :- Must have 4 years of Experience on Python.- Must have 4 years' relevant experience on Apache Spark OR pyspark. - Must have 4 years of experience in SQL [Must be proficient in writing Advanced complex queries]. - Must have 4 years' relevant experience on...

  • RBHU Analytics

    3 weeks ago


    Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Responsibilities :1. Assume ownership of Data Engineering projects from inception to completion.2. Implement fully operational data warehouse solutions in production environments using Snowflake.3. Showcase proficiency in Snowflake data modelling and ELT techniques with Snowflake SQL, including the implementation of complex stored procedures and adherence to...


  • Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Responsibilities :1. Assume ownership of Data Engineering projects from inception to completion.2. Implement fully operational data lakehouse solutions in production environments using Databricks.3. Showcase proficiency in Pyspark based data modelling and transformation4. Extract and model data from sources like XML, CSV, txt and other file formats and store...

  • Data Engineer

    4 weeks ago


    Bangalore/Mumbai, Maharashtra, India Cyitechsearch Full time

    Job Description :- Minimum experience 4 to 11 years.Locations : Bangalore & Mumbai. Max Notice Period : 45 Days. Job Overview : The role of Data Engineer involves leading complex business reengineering development projects and solving organizational problems through IT solutions using Big Data concepts, Platform tools, and software engineering languages as...

  • Azure Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Innovation Consulting Services Full time

    Job Description :Responsibility : 1. Integrate, transform, and consolidate data from various structured and unstructured data systems into structures that are suitable for building analytics solutions by creating datawarehouse/Datamart in Azure Synapse Analytics. 2. Should have strong experience in writing SQL Scripts, Stored Procedures & Views. 3. Design...


  • Mumbai, Maharashtra, India Olive Trees Consulting Full time

    Job Description :- Our IT client based in Malad, Mumbai is looking for a Data Mesh Engineer. The main purpose of the role is to design, build, and maintain data pipelines and infrastructure using Microsoft Fabric components. You'll play a crucial role in enabling data mesh architecture within the organization, ensuring scalability, reliability, and...


  • Mumbai, Maharashtra, India Cornerstone OnDemand Full time

    We are seeking a Senior DataEngineer with expertise in Looker and Google Cloud Platform (GCP) to join ourinnovative team. With at least 10 years of overall experience in dataengineering, including a minimum of 5 years working with Looker and GCP, theideal candidate will lead the design, development, and maintenance of LookMLmodels and dashboards. This role...

  • Data Analyst

    4 weeks ago


    Mumbai/Navi Mumbai, Maharashtra, India GM INFOTECH Full time

    Job Profile : Data AnalystExperience : 3+ YearsJob Overview : Data Analyst will be responsible for managing the analytics assignment. The role requires good blend of functional and technical know-how and the ability to connect with the clients. The role requires good learning agility on both domain and technology front. Should have experience in...

  • Data Migration Head

    4 weeks ago


    Pune/Mumbai, Maharashtra, India xl advisors Full time

    Job Description :The ideal candidate will have a strong background in designing, implementing, and maintaining data solutions on the Azure platform. You will collaborate closely with cross-functional teams to understand data requirements, architect solutions, and implement pipelines to enable data-driven decision-making. This role requires a deep...


  • Mumbai/Pune/Navi Mumbai, Maharashtra, India Reliable Group Full time

    Title : Azure Cloud Architect Location : Mumbai / :As a leader in AI, we are seeking an experienced Azure Cloud Architect to join our technology team. This role is crucial for developing robust, secure, and scalable cloud solutions that meet the demands of our multi-tenant SaaS products. If you have a strong background in Azure services, are still hands-on,...


  • Mumbai, Maharashtra, India WiseBee Consultants Full time

    Job Description and Duties :- 6 - 10 years overall experience as ML Engineer or Data Scientist and able to work comfortably with Microsoft Azure cloud platform/stack skilled in productionising ML models into Azure architecture- Use exceptional mathematical skills, in order to perform computations and work with algorithms involved in NLP and Text Analytics...

  • Data Engineer

    3 weeks ago


    Mumbai, Maharashtra, India timesjobs Full time

    Please share your resume at ruchita.-Experience: 4 YearsLocation : MumbaiJob Description:4 years (must) relavent experience in Bigdata and cloud technologies with can do attitudeBig data tools: Spark etc.Relational SQL and NoSQL databases.Data pipeline and workflow management tools: Azure Data Factory, Airflow, etc.Azure cloud services: Data lake,...

  • RBHU Analytics

    4 weeks ago


    Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Description : We are looking for bright, young engineers with prior knowledge of Power BI development, data-warehousing and ETL.Knowledge Area : - T-SQL, Power-BIResponsibilities : Selected candidates will be responsible for the following :1. Understand requirements given by business users in the retail functional domain.2. Access data stored in Azure Data...


  • Mumbai, Maharashtra, India timesjobs Full time

    Senior Data EngineerOpening: 1 Nos.Job ID: 73272Employment Type: Full TimeReference:Work Experience: 2.0 Year(s) To 3.0 Year(s)CTC Salary: 8.00 LPA TO 12.00 LPAIndustry: Banking/Financial ServicesLocation: MumbaiPosted On: 11th Dec, 2023Share On WhatsAppShare LinkedInShare FacebookShare TwitterJob Description: Analyse and organize raw dataBuild data systems...


  • Mumbai/Navi Mumbai, Maharashtra, India Looper Development Services Private Limited Full time

    Job Description :- Bachelor's or advanced degree in Computer Science, Information Technology, or related field.- Proven experience as a Back-End Data Engineer or similar role.- Proficiency in database design and management (e.g., SQL, NoSQL).- Strong programming skills in languages such as Python, Java, or Scala.- Experience with ETL tools and data...