Senior Data Engineer

2 weeks ago


india IT Full time

We are seeking a talented Senior Data Engineer with a strong background in developing ETLs and data pipelines using Apache Spark with the PySpark library.

The ideal candidate will have proven experience in data modeling for data warehousing use cases, designing patterns, and building highly scalable and secure solutions.

Additionally, experience with Azure Stack, workflow management tools like Apache Airflow, Scrum, and DevOps methodology is required.

Responsibilities :

- Develop and maintain ETL processes and data pipelines using Apache Spark with PySpark library.

- Design and implement data models for data warehousing use cases, ensuring scalability and security.

- Collaborate with cross-functional teams to gather and understand data requirements.

- Implement best practices for data processing, storage, and retrieval.

- Utilize Azure Stack for cloud-based data solutions.

- Develop and maintain workflow automation using Apache Airflow.

- Work closely with stakeholders to understand business requirements and translate them into technical solutions.

- Follow Scrum and DevOps methodologies to deliver high-quality solutions in a timely manner.

- Continuously learn and stay updated on emerging technologies and industry trends.

- Foster effective teamwork and collaboration within the engineering team.

Requirements :

- Bachelor's/Master's degree in Computer Science, Engineering, or a related field.

- Proven experience as a Data Engineer with a focus on developing ETLs and data pipelines using Apache Spark with PySpark library.

- Strong understanding of data modeling concepts and experience designing data warehouses.

- Experience with Azure Stack for cloud-based data solutions.

- Proficiency in workflow management tools like Apache Airflow.

- Familiarity with Scrum and DevOps methodologies.

- Open-minded, flexible, self-reflective, and sincere approach to work.

- Eager to learn and grow in a dynamic environment.

- Excellent communication and collaboration skills.

(ref:hirist.tech)

  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...


  • India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Senior Data Engineer

    3 weeks ago


    India hunterAI Full time

    Company DescriptionJoin hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    3 weeks ago


    India hunterAI Full time

    Company Description Join hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    9 hours ago


    india OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION:• Analyze and understand  data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data•...


  • India Accelerant Full time

    Job Type - ContractLocation- IndiaExperience - 8+ yearsNOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau.Role DescriptionThis is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering, including data...


  • india PrimEra Medical Technologies Full time

    Job Description: Senior Data Engineer About PrimEra: PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact. Position Overview: We are seeking a highly skilled...


  • india Accelerant Full time

    Job Type - Contract Location- India Experience - 8+ years NOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau. Role Description This is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering,...


  • india True Tech Professionals Full time

    Senior Data Engineer Location: Gurgaon (Hybrid Mode) Experience: 5 years and above. Immediate Joiners Preferred (Notice Period: 10 - 15 days) We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL....

  • Senior Data Engineer

    3 weeks ago


    india Next-Link Full time

    Job Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...


  • india K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Data Engineer

    2 weeks ago


    india INI8 LABS Full time

    Job Description: We are looking for an experienced Senior Azure Data Engineer to join our team. The successful candidate should have experience working with Data Architects, Analyst and Stakeholders to develop, maintain and test data platforms. Experience: Minimum 4+ yrs Experience with Azure(Azure data bricks, Azure data factory, PySpark) minimum of 4...

  • Senior Data Engineer

    2 weeks ago


    India SourceBae Full time

    Senior Data EngineerExp-6+YrsShift Time : 2 PM - 11 PMAs a Senior Data Engineer , you will: Design, Architect, and Develop solutions leveraging cloud big data technology to ingest,process and analyze large, disparate data sets to exceed business requirements Develop systems that ingest, cleanse and normalize diverse datasets, develop datapipelines from...

  • Senior Data Engineer

    2 weeks ago


    india SourceBae Full time

    Senior Data Engineer Exp-6+Yrs Shift Time : 2 PM - 11 PM As a Senior Data Engineer , you will:  Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements  Develop systems that ingest, cleanse and normalize diverse datasets, develop data...

  • Senior Data Engineer

    3 weeks ago


    india V3 Staffing Solutions India P Limited Full time

    We have this opening with the global company that is shaping the future of gaming through groundbreaking technology and unparalleled creativity. Senior Data Engineer (AWS): Crafting Efficient Data Pipelines for Cloud Platforms We're seeking a seasoned Senior Data Engineer with over 9 years of hands-on experience in crafting and implementing highly...

  • Senior Data Engineer

    1 month ago


    india Recro Full time

    Position: Senior Data Engineer Location: Bangalore Type: Full-Time Experience Level: 4.5+ years Job Description: We're building a high-performing data team and searching for a skilled and passionate Data Engineer to join us! You'll be responsible for designing, developing, and maintaining our data infrastructure, ensuring a steady flow of clean,...


  • india Lapis Data Analytics Full time

    Company Description Lapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Senior Data Engineer

    3 weeks ago


    india Tredence Inc. Full time

    Data Engineering - Associate Manager (6-10 Years) / Manager (10-14 Years) This position requires someone with good problem solving, business understanding and client presence. Overall professional experience of the candidate should be above 10 years. A minimum of 6 years of experience in leading and managing a client portfolio in Data Engineering space....


  • india Mopid Full time

    Senior Data Engineer Position Experience Range: 4-8 years Job Timing: This position is full-time Job Type: The role requires working in-office from our Hyderabad location. If you are passionate about leveraging data to drive business success, have a keen eye for detail, and are looking for an opportunity to bring your expertise to a vibrant team, we would...