Senior Azure Data Engineer

1 week ago


Mumbai, Maharashtra, India Techno Wise Full time

Responsibilities :

  • Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.
  • Optimize and tune existing data pipelines for performance and reliability.
  • Work closely with cloud-based services, particularly Azure or AWS, to deploy and manage data solutions in the cloud environment.
  • Implement data quality and data governance best practices to ensure the accuracy and reliability of the data.
  • Monitor and troubleshoot data pipelines, resolving issues promptly to minimize downtime and data loss.
  • Stay updated with the latest industry trends and technologies related to data engineering, Databricks, PySpark, and cloud platforms.
  • Collaborate with cross-functional teams to integrate data engineering solutions into various applications and systems.
  • Document data engineering processes, architectures, and configurations for reference and knowledge sharing.
  • Provide technical guidance and mentorship to junior data engineers in the team.

Requirements :

Responsibilities :

  • Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.
  • Utilize Databricks for big data analytics and realtime data processing, ensuring optimal performance and efficiency.
  • Collaborate with data architects to design and implement effective data models and architectures to support business requirements.
  • Implement ETL processes for data extraction, transformation, and loading, ensuring the integrity and quality of the data.
  • Integrate data from various sources, ensuring compatibility, accuracy, and adherence to data governance standards.
  • Identify and address performance bottlenecks in data pipelines, optimizing for speed, reliability, and scalability.
  • Work closely with crossfunctional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.
  • Conduct code reviews, enforce best practices in coding and documentation, and mentor junior team members.

Education :

  • Bachelor's or master's degree in Computer Science, Information Systems, or a related field.

Experience :

  • Minimum of 6 years of handson experience as a Data Engineer, with a focus on Azure Data Engineering and Databricks.

Technical Skills :

  • Proficiency in Azure Data Factory, Azure Databricks, SQL, Python, and ETL processes.
  • Solid understanding of data modelling, data warehousing, and big data concepts.
)

  • Mumbai, Maharashtra, India Firstcareercentre Full time

    Job Brief SummarySenior Azure Data EngineeringTotal Experience :5 Years If candidate is good can take 4+ yrs as wellLocation : Mumbai Must have 4 Years of Experience on Python Must have 4 yrs relevant experience on Apache Spark OR PySpark Must have 5 yrs of experience in SQL (Must be proficient in writing Advanced complex queries ) Good to have Airflow...


  • Mumbai, Maharashtra, India Firstcareercentre Full time

    Job Brief SummarySenior Azure Data EngineeringTotal Experience : - 5 Years - If candidate is good can take 4+ yrs as wellLocation : Mumbai- Must have 4 Years of Experience on Python- Must have 4 yrs relevant experience on Apache Spark OR PySpark- Must have 5 yrs of experience in SQL [Must be proficient in writing Advanced complex queries ]- Good to have...


  • Mumbai, Maharashtra, India Firstcareercentre Full time

    Job Brief SummarySenior Azure Data EngineeringTotal Experience : - 5 Years - If candidate is good can take 4+ yrs as wellLocation : Mumbai- Must have 4 Years of Experience on Python- Must have 4 yrs relevant experience on Apache Spark OR PySpark- Must have 5 yrs of experience in SQL [Must be proficient in writing Advanced complex queries ]- Good to have...

  • Senior Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India IT Resource Hunter Full time

    We are seeking an experienced Senior Data Engineer to join our team and build robust end-to-end data integration solutions within an Azure cloud environment. The ideal candidate will have a strong background in data engineering, business intelligence, and a variety of digital technology projectsKey Responsibilities:- Build end-to-end data integration...

  • Senior Data Engineer

    3 weeks ago


    Mumbai, Maharashtra, India IT Resource Hunter Full time

    We are seeking an experienced Senior Data Engineer to join our team and build robust end-to-end data integration solutions within an Azure cloud environment. The ideal candidate will have a strong background in data engineering, business intelligence, and a variety of digital technology projectsKey Responsibilities:- Build end-to-end data integration...

  • Azure Data Engineer

    7 days ago


    Mumbai, Maharashtra, India Scalene works Full time

    Key Responsibilities Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services. Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse. Developing data models and maintaining data architecture to support data analytics and business...


  • Mumbai, Maharashtra, India GPI Full time

    OverviewWe are looking for a Senior data engineer to take on the responsibility of designing data pipelines and enabling Azure cloud services, perform hands-on development, and maintaining data pipelines and build/deploy Azure services.The Senior Data Engineer will oversee GPI's data integration work, including developing robust data models, developing data...


  • Mumbai, Maharashtra, India GPI Full time

    Overview We are looking for a Senior data engineer to take on the responsibility of designing data pipelines and enabling Azure cloud services, perform hands-on development, and maintaining data pipelines and build/deploy Azure services. The Senior Data Engineer will oversee GPI's data integration work, including developing robust data models, developing...

  • Azure Data Engineer

    7 days ago


    Mumbai, Maharashtra, India John Cockerill Full time

    Location -Mumbai, IndiaJob PurposeAs an Azure Data Engineer, your main responsibilities will include understanding end user's needs, translating them intro ETL pySpark scripts, orchestrating ETL with Synapse, testing the solution and eventually deploying to the production environment.Key ResponsibilitiesDevelop, construct, test, and maintain architectures...

  • Azure Data Engineer

    1 week ago


    Mumbai, Maharashtra, India John Cockerill Full time

    Location - Mumbai, India Job Purpose As an Azure Data Engineer, your main responsibilities will include understanding end user's needs, translating them intro ETL pySpark scripts, orchestrating ETL with Synapse, testing the solution and eventually deploying to the production environment. Key Responsibilities Develop, construct, test, and maintain...


  • Mumbai, Maharashtra, India Invokhr Full time

    Aays AnalyticsPosition: Senior Data Engineer / Data EngineerDesired Experience: 3-8 yearsYou will act as a key member of the Data consulting team, working directly with the partners and seniorstakeholders of the clients designing and implementing big data and analytics solutions. Communicationand organisation skills are keys for this position, along with a...


  • Mumbai, Maharashtra, India consultant Full time

    Openings for the role of Data Engineer/Senior Data EngineerRequirements:Over 5 years of experience as a Data EngineerProficiency in Python, PySpark, and SQL databasesFamiliarity with Azure, Databricks, and Google Cloud Platform (GCP)Expertise in software development lifecycle and best practicesExperience with ETL processes, data pipelines, and data...


  • Mumbai/Bangalore, Maharashtra, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...


  • Mumbai/Bangalore, Maharashtra, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...


  • Mumbai, Maharashtra, India Anicalls (Pty) Ltd Full time

    Build and enhance the Azure Spark ecosystem in the areas of performance, Scale, security, availability, and enterprise readiness. Contribute to the architecture & design of the Azure Data products. Building cloud-scale products with a focus on efficiency, reliability, and security. Helping evolve engineering practices & principles that marry the flexibility...

  • Azure Data Engineer

    7 days ago


    Mumbai, Maharashtra, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing RESPONSIBILITIES: • Be an integral part of large scale client business development and delivery engagements • Develop the software and systems needed for end-to-end execution on large projects • Work across all phases of SDLC, and use Software Engineering principles to...


  • Mumbai, Maharashtra, India IT Resource Hunter Full time

    We are seeking an experienced Senior Data Engineer to join our team and build robust end-to-end data integration solutions within an Azure cloud environment. The ideal candidate will have a strong background in data engineering, business intelligence, and a variety of digital technology projectsKey Responsibilities:Build end-to-end data integration solutions...


  • Mumbai, Maharashtra, India White Force Full time

    Job Description: Key Responsibilities:1. Design, develop, and deploy scalable data pipelines on the Azure cloud platform using AzureData Factory (ADF).2. Architect end-to-end data solutions to support business requirements and analyticalinsights, with a focus on Databricks (PySpark) for data processing.3. Implement and optimize data processing workflows...


  • Mumbai, Maharashtra, India Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role : This role is more focused on Pyspark with Cloud developer.About the Responsibilities : This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of crossfunctional software products under a microservices styled...

  • Senior Data Analyst

    3 weeks ago


    Mumbai, Maharashtra, India se Full time

    Job Title: Senior Data Analyst. Location: Mumbai, Kurla. Department: Data Science. Job Purpose: The Senior Data Analyst is responsible for conducting strategic analyses and reporting to support key business decisions. This role involves providing impactful insights to CXO and Business Head level stakeholders.Key Responsibilities:- Lead the Data Analytics...