Data Engineer

3 weeks ago

new delhi, India PanScience Innovations (PSI) Full time

Location : Lucknow, UP

Job Type : Full-time

Experience : 3-5 Years


Position Summary :

We are seeking a highly skilled Data Engineer with 3-5 years of professional experience in building low-latency, high-throughput, scalable, and distributed systems in cloud infrastructure, preferably AWS. The ideal candidate will have a deep understanding of I/O latency, networking, HTTP/HTTPS, and strong expertise in Java or Python. The role will involve developing robust data engineering pipelines using cutting-edge technologies like Spark, Flink, Storm, Kafka, Elasticsearch, Logstash, Kafka Connect, or similar.


Key Responsibilities :


  • Design, develop, and maintain highly scalable, low-latency data engineering pipelines in cloud environments (preferably AWS).
  • Implement distributed data processing systems using frameworks like Apache Spark, Flink, Storm, etc.
  • Develop, deploy, and manage messaging and stream-processing systems using Kafka or similar technologies.
  • Optimize systems for performance by reducing I/O latency and ensuring high-throughput processing.
  • Ensure robust data storage and retrieval systems, leveraging both RDBMS and NoSQL databases.
  • Collaborate with cross-functional teams, including data scientists, software engineers, and DevOps to deliver high-performance data pipelines.
  • Monitor and troubleshoot the performance and availability of production systems, identifying and resolving bottlenecks.
  • Apply best practices in data architecture, ensuring secure, scalable, and efficient systems.
  • Document technical designs, system architectures, and implementation strategies.


Required Qualifications :


  • Education : Bachelor's Degree in Engineering (B.E./B.Tech.) in Computer Science, Information Technology, or related fields.
  • Experience : 3-5 years of experience building scalable and distributed systems in cloud infrastructure (preferably AWS).
  • Strong proficiency in Java or Python for data pipeline development.
  • Deep understanding of cloud infrastructure, distributed systems, and cloud-native services.
  • Expertise in I/O latency, networking, and protocols such as HTTP/HTTPS.
  • Experience with big data processing frameworks such as Apache Spark , Apache Flink , or Apache Storm .
  • Hands-on experience with message brokers and stream-processing technologies like Apache Kafka , Kafka Connect , etc.
  • Solid understanding of RDBMS (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Cassandra, DynamoDB, Elasticsearch).
  • Familiarity with data pipeline orchestration tools and monitoring platforms.


Preferred Skills :


  • Experience with AWS services (EC2, S3, RDS, EMR, Lambda, etc.).
  • Familiarity with DevOps tools for CI/CD and infrastructure management (Terraform, Ansible).
  • Knowledge of data warehousing concepts and tools like Redshift, Snowflake.
  • Experience with containerization and orchestration technologies (Docker, Kubernetes).


Key Competencies :


  • Excellent problem-solving skills with attention to detail.
  • Ability to work in a fast-paced, collaborative environment.
  • Strong communication skills and the ability to work well in a team.


Compensation : 6 -12 LPA

  • Data Engineer

    3 months ago

    New Delhi, India mccainfood Full time

       Position Title: Data EngineerPosition Type: Regular - Full-Time ​Position Location: New Delhi Requisition ID: 30910   Position SummaryData Engineers are primarily responsible for designing, building, managing, and operationalizing data pipelines in support of key data and analytics use cases. They are accountable for guaranteeing compliance...

  • Data Engineer

    4 weeks ago

    New Delhi, India The Digital Group Inc Full time

    Role DescriptionThis is a full-time hybrid role for a Data Engineer at The Digital Group Inc in the Greater Delhi Area, with flexibility for remote work. The Data Engineer will be responsible for tasks such as data engineering, ETL processes, and building data handling frameworks.QualificationsData Engineering, ETL skillsExpertise in optimizing Apache Spark...

  • MS Engineer L3

    4 months ago

    New Delhi, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    2 months ago

    new delhi, India emagine Full time

    Job Title: Data Engineer – GCP SpecialistDepartment: Data EngineeringLocation: remote ( India )Employment Type: (Contract)Position Summary:We are seeking an experienced Data Engineer with a strong background in Google Cloud Platform (GCP) services to join our team. The ideal candidate will have significant expertise in Dataflow, DBT, and other GCP...

  • Data Engineer

    2 months ago

    new delhi, India Hanuma InfoTech Full time

    Responsibilities:Build ML infrastructure in the cloud environmentDevelop and maintain data pipelines to support machine learning models, including data cleaning, prep-processing data, training and evaluation of modelsSupport Prompt Engineering development that utilizes LLM and deep learning frameworksCollaborate with teams to design and implement solutions,...

  • Senior MS Engineer

    4 months ago

    New Delhi, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Service Delivery Field Support Engineer

    4 months ago

    New Delhi, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    3 weeks ago

    new delhi, India PanScience Innovations (PSI) Full time

    Location: Lucknow, UPJob Type: Full-timeExperience: 3-5 YearsPosition Summary:We are seeking a highly skilled Data Engineer with 3-5 years of professional experience in building low-latency, high-throughput, scalable, and distributed systems in cloud infrastructure, preferably AWS. The ideal candidate will have a deep understanding of I/O latency,...

  • Data Engineer

    3 weeks ago

    New Delhi, India PanScience Innovations (PSI) Full time

    Location: Lucknow, UPJob Type: Full-timeExperience: 3-5 YearsPosition Summary:We are seeking a highly skilled Data Engineer with 3-5 years of professional experience in building low-latency, high-throughput, scalable, and distributed systems in cloud infrastructure, preferably AWS. The ideal candidate will have a deep understanding of I/O latency,...

  • Data Engineer

    3 weeks ago

    New Delhi, India PanScience Innovations (PSI) Full time

    Location: Lucknow, UPJob Type: Full-timeExperience: 3-5 YearsPosition Summary:We are seeking a highly skilled Data Engineer with 3-5 years of professional experience in building low-latency, high-throughput, scalable, and distributed systems in cloud infrastructure, preferably AWS. The ideal candidate will have a deep understanding of I/O latency,...

  • MS Engineer L1

    4 months ago

    New Delhi, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Python Data Engineer

    2 weeks ago

    new delhi, India CredHive Full time

    Position OverviewWe are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for...

  • Python Data Engineer

    1 month ago

    new delhi, India CredHive Full time

    Position Overview We are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for...

  • Python Data Engineer

    2 weeks ago

    New Delhi, India CredHive Full time

    Position Overview We are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for...

  • Python data engineer

    2 weeks ago

    New Delhi, India CredHive Full time

    Position Overview We are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information...

  • Python Data Engineer

    2 months ago

    New Delhi, India CredHive Full time

    Position OverviewWe are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for...

  • Python Data Engineer

    1 month ago

    new delhi, India CredHive Full time

    Position OverviewWe are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for...

  • Lead Data Engineer

    1 month ago

    New Delhi, India Logic Software Solutions Full time

    Job Description: Lead Data Engineer (GCP Domain)Position Overview:We are seeking an accomplished Lead Data Engineer with over 12 years of specialized experience in architecting and deploying data engineering solutions on the Google Cloud Platform (GCP). The ideal candidate will exemplify strong leadership exhibiting a proven history of driving largescale...

  • Lead Data Engineer

    3 weeks ago

    new delhi, India Logic Software Solutions Full time

    Job Description: Lead Data Engineer (GCP Domain)Position Overview:We are seeking an accomplished Lead Data Engineer with over 12 years of specialized experience in architecting and deploying data engineering solutions on the Google Cloud Platform (GCP). The ideal candidate will exemplify strong leadership exhibiting a proven history of driving largescale...

  • Lead Data Engineer

    1 week ago

    new delhi, India Logic Software Solutions Full time

    Job Description: Lead Data Engineer (GCP Domain) Position Overview:We are seeking an accomplished Lead Data Engineer with over 12 years of specialized experience in architecting and deploying data engineering solutions on the Google Cloud Platform (GCP). The ideal candidate will exemplify strong leadership exhibiting a proven history of driving largescale...