Data Engineer

3 days ago

Gurugram, India Coders Brain Technology Private Limited Full time

Job Title : Data Engineer

Location : Noida/Gurugram

Experience : 8+ Years

Job Overview :


We are seeking an experienced Data Engineer with strong expertise in data technologies and AWS Cloud services. The ideal candidate will have a deep understanding of OLAP systems like ClickHouse and experience with distributed data processing frameworks. If you are skilled in Java/Scala and Python and thrive in a collaborative environment, this is an excellent opportunity for you.

Key Responsibilities :

Data Engineering and Development :

- Design, develop, and optimize scalable data pipelines and data warehouses.

- Implement OLAP systems, focusing on ClickHouse or similar technologies.

AWS Cloud Services :


- Leverage AWS Cloud services for data storage, processing, and analytics.

- Ensure secure and efficient data management using AWS best practices.

Distributed Data Processing Frameworks :


- Work with frameworks like Spark (Core, Streaming, SQL), Storm, or Flink for processing large-scale datasets.

- Optimize frameworks for high performance and low latency.

Programming and Scripting :


- Develop robust applications using Java/Scala.

- Write scripts and utilities using Python for data transformations and automation.

Collaboration and Optimization :


- Collaborate with cross-functional teams to understand and fulfill data requirements.

- Optimize data workflows and systems for scalability and performance.

Skill Set Requirements :


Technical Expertise :


- 8+ years of IT experience with 5+ years in data-related technologies.

- At least 3+ years of expertise in AWS Cloud services related to data engineering.

- 3+ years of experience with OLAP systems, specifically ClickHouse or similar.

Programming Languages :


- Proficiency in Java/Scala for building data-intensive applications.

- Strong skills in Python for data manipulation and scripting.

Distributed Data Processing Frameworks :


- Hands-on experience with frameworks like Spark, Storm, or Flink.

- Proficiency in Spark modules: Core, Streaming, and SQL.

AWS Cloud Expertise :


- Experience with services such as AWS S3, Redshift, Glue, Lambda, EMR, and Kinesis.

Qualifications :

- Bachelor's/Master's degree in Computer Science, Information Technology, or a related field.

- Proven experience in designing and optimizing scalable data solutions.

- Strong analytical and problem-solving skills.

- Excellent communication and collaboration skills.

(ref:hirist.tech)

  • Data Engineer

    2 months ago

    gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer/Senior Data Engineer

    1 month ago

    Gurugram, India Cognitio Analytics Inc Full time

    Experience:1 to 8 years - DE/ Sr. DE/ AM /ManagerMust Have:SQLPython/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOpsETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data SecurityAgile Practices, SDLCData Exploration, Data Quality metrics, Historical data Management, Good...

  • Data Engineer/Senior Data Engineer

    1 month ago

    Gurugram, India Cognitio Analytics Inc Full time

    Experience: 1 to 8 years - DE/ Sr. DE/ AM /Manager Must Have: SQL Python/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOps ETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data Security Agile Practices, SDLC Data Exploration, Data Quality metrics, Historical data...

  • Data Engineer

    4 weeks ago

    Gurugram, India Aays Full time

    Position : Senior Data Engineer / Data Engineer Desired Experience : 3+ years You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...

  • Data Engineer

    4 weeks ago

    Gurugram, India Aays Full time

    Position: Senior Data Engineer / Data Engineer Desired Experience: 3+ years You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...

  • Data Engineer

    4 weeks ago

    Gurugram, India Aays Full time

    Position: Senior Data Engineer / Data Engineer Desired Experience: 3+ years You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...

  • Data Engineer

    7 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    5 months ago

    Gurugram, India Siemens Energy Full time

    Data Engineer About the Role Location India Haryana Gurugram Company Siemens Energy Industrial Turbomachinery India Private Limited Organization EVP Global Functions Business Unit Digital Core Full / Part time Full-time Experience Level Experienced Professional A Snapshot of Your Day Data Engineer is an engineering role within a data...

  • Data Engineer

    1 week ago

    Gurugram, India Straive Full time

    Job Title: Data Engineer Location: Hyderabad/Bangalore/Gurgaon Job Type: Full time Years of Experience- 6-11 years About Straive: Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains. Data Analytics & Al Solutions, Data Al Powered Operations and...

  • Data Engineer

    6 months ago

    Gurugram, India Circle K Full time

    JOB DESCRIPTION Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with 16,700 stores in 31 countries, serving more than 9 million customers each day. It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported...

  • Data Engineer

    6 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    6 months ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    2 months ago

    gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    1 month ago

    Gurugram, India IGT Solutions Full time

    Job Overview:Data Engineer(Immediate Joiners Preferred)Exp:7+ YearsThe Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the appropriate...

  • Data Engineer

    1 month ago

    Gurugram, India IGT Solutions Full time

    Job Overview:Data Engineer(Immediate Joiners Preferred)Exp:7+ YearsThe Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the appropriate...

  • Data Engineer

    1 month ago

    Gurugram, India IGT Solutions Full time

    Job Overview: Data Engineer(Immediate Joiners Preferred) Exp:7+ Years The Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the...

  • Data Engineer

    4 months ago

    Gurugram, India Publicis Groupe Full time

    Job Description Description: As a Data Engineer, you will develop and deliver solutions that enable our agency teams to win in a very competitive marketplace. The right candidate will be somebody who is motivated to get it done, loves to continually learn and builds software utilizing modern technologies and strong engineering practices. Our team is...

  • Data Engineer

    7 months ago

    Gurugram, India TransOrg Analytics Full time

    Location : Gurgaon/Mumbai Job ID : DE2008 Job Type : Full time Experience : 2-6 years Why would you like to join us? TransOrg Analytics, an award winning – Big Data and Predictive analytics- company, offers advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, UK, Singapore and the Middle East. Our products...

  • Data Engineer

    4 weeks ago

    Gurugram, India SourceBae Full time

    Position: Data EngineerExperience Level: 3-5 YearsLocation: Hybrid (3 days onsite per month at CyberHub, Gurgaon)Must-Have Skills:PySparkAzureAzure Data Factory (ADF)DatabricksETL ProcessesSQLGood-to-Have Skills:Change Management ToolsDevOpsRole Description:We are looking for a skilled Data Engineer to design and build robust data solutions. In this role,...

  • Data Engineer

    4 weeks ago

    Gurugram, India SourceBae Full time

    Position: Data Engineer Experience Level: 3-5 Years Location: Hybrid (3 days onsite per month at CyberHub, Gurgaon) Must-Have Skills: PySpark Azure Azure Data Factory (ADF) Databricks ETL Processes SQL Good-to-Have Skills: Change Management Tools DevOps Role Description: We are looking for a skilled Data Engineer to design and build robust data...