Senior Data Engineer

4 weeks ago

Hyderabad, India CogentIBS Full time

Senior Data Engineer

Location - Hyderabad

We are recruiting for an experienced Senior Data Engineer and we'll give you the opportunity to grow and develop your capabilities as well as supporting you through Microsoft certifications.


You'll have experience in :

- Developing low to high complexity, secure, governed, high quality and efficient data pipelines from a variety of on and off premise, internal and external data source.

- Ensuring that data is cleansed, mapped, transformed and optimised for storage to meet requirements for business and technical use cases.

- Building data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies.

- Take all requirements into account when creating a proposal

- Understanding and evaluating the organisational impact of new technologies and digital services

- Troubleshooting and resolving issues

- You may be building solutions that transform data into data lake storage areas, physical database models and reporting structures across data lakes, data warehouse, business intelligence systems and analytics applications.

- You may also be required to carry out unit testing of own code and peer testing of others to ensure appropriate quality.

Experience :

- Experience of working with large, event based, datasets in an enterprise environment.

- Minimum 4 years within an Azure or SQL Data Engineering environment

- Engineering and database skills in SQL Server and/or Azure (Data Factory, Synapse) and the associated ETL technologies.

- Experience developing, driving & maintaining Data Integration Roadmaps and best practices.

- Overall responsibility of all technical business requirements gathering deliverables and implementation.

- Ability to deliver high to low-level designs for Data Solutions and have a good understanding of the full data lifecycle.

- Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse, Python, Pyspark etc.

- Hands-on experience designing and developing stored procedures/functions and leveraging ETL packages/workflows

- Expertise in Cloud related Big Data integration and infrastructure tech stack using Azure Databricks & Apache Spark framework

- Well-versed with scripting languages such as Python

- Experience of Continuous Integration / Continuous Delivery (CI/CD).

- Experience of working in an agile environment and self-managing teams.

- Understanding and practical knowledge of testing techniques and tools

Desired technologies :

- Big Data

- Azure

- Spark

- Python

- Azure Databricks

- Azure Synapse

- Azure Data Factory

- SQL Server

(ref:hirist.tech)

  • Senior Azure Data Engineer

    3 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Senior Azure Data Engineer

    4 weeks ago

    hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Senior Azure Data Engineer

    4 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, India LTIMindtree Full time

    Senior Data EngineerJob Req Id: 1248440 Bachelor’s Degree in Computer Science or a related discipline • 5+ years of applicable engineering experience• Experience in GCP, Big Query• Strong proficiency in Python with an emphasis in building data pipelines• Ability to write complex SQL to perform common types of analysis and aggregations• Experience...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, India Epam Full time

    DescriptionEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver...

  • Senior Data Engineer

    4 weeks ago

    Hyderabad, India Larsen & Toubro Infotech Ltd Full time

    Senior Data Engineer Job Req Id: 1248440 Bachelor’s Degree in Computer Science or a related discipline• 5+ years of applicable engineering experience• Experience in GCP, Big Query• Strong proficiency in Python with an emphasis in building data pipelines• Ability to write complex SQL to perform common types of analysis and aggregations •...

  • Senior Data Engineer

    2 weeks ago

    hyderabad, India Zenwork, Inc Full time

    Job Title: Senior Data Engineer - AWS, Redshift, QuickSightJob Description:We seek an experienced Data Engineer to join our team and help optimize our data processing and visualization capabilities. The ideal candidate will have a strong background in data engineering, particularly leveraging AWS products.Roles and Responsibilities:·      Design,...

  • Senior Data Engineer

    4 weeks ago

    hyderabad, India LTIMindtree Full time

    Senior Data Engineer Job Req Id: 1248440 Bachelor’s Degree in Computer Science or a related discipline• 5+ years of applicable engineering experience • Experience in GCP, Big Query • Strong proficiency in Python with an emphasis in building data pipelines • Ability to write complex SQL to perform common types of analysis and aggregations •...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, India Swiss Re Full time

    About the RoleAs a Senior Data Engineer, you will contribute to and support data management activities using most advanced Microsoft Azure technologies. The data management team enables data scientists and data analysts to provide risk knowledge advice and insights as well as data analytics SaaS solutions to Swiss Re clients.Key responsibilities...

  • Senior Data Engineer

    4 weeks ago

    hyderabad, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, India Apptad Inc. Full time

    Role - Senior Data EngineerExp - 7+ yrsLocation - Bangalore/Hyderabad* Proficient in Python to design, develop, and maintain scalable data pipelines and ETL processes. * Has knowledge in pulling data using R via API's.* Extensive experience in building and optimizing data architectures, as well as strong skills in data modeling and SQL. * Capable enough to...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, India Apptad Inc. Full time

    Role - Senior Data EngineerExp - 7+ yrsLocation - Bangalore/Hyderabad* Proficient in Python to design, develop, and maintain scalable data pipelines and ETL processes. * Has knowledge in pulling data using R via API's.* Extensive experience in building and optimizing data architectures, as well as strong skills in data modeling and SQL. * Capable enough to...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, India Apptad Inc. Full time

    Role - Senior Data Engineer Exp - 7+ yrs Location - Bangalore/Hyderabad * Proficient in Python to design, develop, and maintain scalable data pipelines and ETL processes. * Has knowledge in pulling data using R via API's. * Extensive experience in building and optimizing data architectures, as well as strong skills in data modeling and SQL. * Capable...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, India Zenwork, Inc Full time

    Job Title: Senior Data Engineer - AWS, Redshift, QuickSightJob Description:We seek an experienced Data Engineer to join our team and help optimize our data processing and visualization capabilities. The ideal candidate will have a strong background in data engineering, particularly leveraging AWS products.Roles and Responsibilities:·      Design,...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, India Zenwork, Inc Full time

    Job Title: Senior Data Engineer - AWS, Redshift, QuickSightJob Description:We seek an experienced Data Engineer to join our team and help optimize our data processing and visualization capabilities. The ideal candidate will have a strong background in data engineering, particularly leveraging AWS products.Roles and Responsibilities:·      Design,...

  • Senior Data Engineer

    2 weeks ago

    hyderabad, India Zenwork, Inc Full time

    Job Title: Senior Data Engineer - AWS, Redshift, QuickSight Job Description: We seek an experienced Data Engineer to join our team and help optimize our data processing and visualization capabilities. The ideal candidate will have a strong background in data engineering, particularly leveraging AWS products. Roles and Responsibilities: ...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, India Crunchyroll Full time

    About CrunchyrollWE HELP EVERYONE BELONG. IT’S OUR PURPOSE.Founded by fans, Crunchyroll delivers the art and culture of anime to a passionate community. We super-serve over 100 million anime and manga fans across 200+ countries and territories, and help them connect with the stories and characters they crave. Whether that experience is online or in-person,...

  • Senior Data Engineer

    3 weeks ago

    hyderabad, India Swiss Re Full time

    About the Role As a Senior Data Engineer, you will contribute to and support data management activities using most advanced Microsoft Azure technologies. The data management team enables data scientists and data analysts to provide risk knowledge advice and insights as well as data analytics SaaS solutions to Swiss Re clients.  Key...

  • Senior Data Engineer

    4 weeks ago

    Hyderabad, India Swiss Re Full time

    About the Role As a Senior Data Engineer, you will contribute to and support data management activities using most advanced Microsoft Azure technologies. The data management team enables data scientists and data analysts to provide risk knowledge advice and insights as well as data analytics SaaS solutions to Swiss Re clients.  Key responsibilities...

  • Senior Data Engineer

    6 days ago

    Hyderabad, India V3 Staffing Solutions India P Limited Full time

    We have this opening with the global company that is shaping the future of gaming through groundbreaking technology and unparalleled creativity.Senior Data Engineer (AWS): Crafting Efficient Data Pipelines for Cloud PlatformsWe're seeking a seasoned Senior Data Engineer with over 9 years of hands-on experience in crafting and implementing highly efficient...