Senior Data Engineer

2 days ago

Gurugram, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

Responsibilities :

- You will be involved in the design of data solutions using Hadoop based technologies along with Hadoop, AWS.

- Responsibilities includes design and implementation of various Big Data platform components like (Batch Processing, Live Stream Processing, In- Memory Cache, Query Layer (SQL), Rule Engine and Action Framework ).

- Design and Implemented Data Access Layer, which can connect to various data sources and uses advanced caching techniques to provide fast responses to real time SQL queries using Big Data Technologies.

- Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies; spark, Kafka, any Cloud computing etc.

Requirements :

- Programming Language : Good hands-on knowledge on one of the programming language java/scala/python.

- Data Store : Good understanding of SQL & NoSQL Data bases. Mysql, Mongo.

- Data Infrastructure : Familiar with cloud solutions for data infrastructure. AWS Preferably.

- Data handling frameworks : Good hands on one of the data handling frameworks - Spark, Apache Beam, Apache - ink etc

- File formats : Familiar di- erent types of data formats - Apache Parquet, Avro, ORC etc.

- Good understanding of how to setup and optimise data pipeline and overall infrastructure for setting up ETL jobs.

- Proficient with distributed file system and computations concepts.

(ref:hirist.tech)

  • Senior Data Engineer

    2 days ago

    Gurugram, India IT Firm Full time

    We are seeking an experienced and highly motivated Senior Data Engineer to join our dynamic team. The ideal candidate will play a critical role in designing, developing, and maintaining high-performance data infrastructure and pipelines. As a Senior Data Engineer, you will be responsible for ensuring the scalability, performance, and reliability of data...

  • Data Engineer

    2 weeks ago

    Bengaluru, Gurugram, India Trigent Software Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Detailed Job Description:We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Gurugram, India Rackspace Technology Full time US$ 1,20,000 - US$ 2,00,000 per year

    JOB DESCRIPTIONCollaborate with customer to gather requirements and to understand their business processes.Create and maintain optimal data pipeline architecture,Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement internal process improvements: automating manual processes, optimizing...

  • Senior Data Engineer

    2 days ago

    Gurugram, India Capgemini Full time

    Job Description Job Description This role involves the development and application of engineering practice and knowledge in defining, configuring and deploying industrial digital technologies (including but not limited to PLM and MES) for managing continuity of information across the engineering enterprise, including design, industrialization,...

  • Agrim - Senior Data Engineer - Python/SQL

    2 days ago

    Gurugram, India AGRIM Full time

    Senior Data Engineer (SDE-3)Location : Gurugram (Work from Office)Experience : 5+Tech Stack : Python, SQL (PostgreSQL/MySQL), Apache Spark, Kafka, Airflow, BigQuery/Redshift, Druid, Hadoop, SnowflakeResponsibilities :- Design and develop scalable ETL pipelines for ingesting and transforming large datasets.- Architect and optimize data warehouses and data...

  • Senior Cloud Engineer

    2 weeks ago

    Noida, Gurgaon / Gurugram, Indore, India beBeeCloud Full time US$ 60,000 - US$ 1,20,000

    Senior Cloud Engineer & Data ScientistWe are seeking a highly skilled and experienced Senior Cloud Engineer & Data Scientist to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying cloud-native solutions using Azure.Job DescriptionThe ideal candidate will have a strong background in software...

  • Data Engineer

    2 days ago

    Gurugram, India NS Global Corporation Full time

    Job Role : Data Engineer - Senior LevelJob Locations : Gurugram, Haryana, IndiaRequired Experience : 7 - 10 YearsClient Budget : 2.0 LPM + GSTOur budget : 1.7 lpmSkills : data warehouse, Architectural Patterns, Modern data engineering tools and framework, AWS, SQL, File FormatsResponsibilities : - Design, develop and own robust data pipelines, ensuring...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Coimbatore, Gurugram, India ThoughtWorks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Coimbatore, Gurugram, India ThoughtWorks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They...

  • Senior Data Sourcing Engineer

    4 days ago

    Gurgaon / Gurugram, Bengaluru / Bangalore, India beBeeDataSourcing Full time ₹ 5,00,000 - ₹ 15,00,000

    Job Title: Senior Data Sourcing EngineerJob DescriptionWe are seeking a highly skilled Senior Data Sourcing Engineer to join our team. As a key member of our organization, you will be responsible for designing and implementing data acquisition strategies to meet the needs of our business.Key Responsibilities:Design and implement data acquisition strategies...