Data Engineer

6 days ago

Greater Hyderabad Area, India Stealth AI Startup Full time

About Us:

Join our stealth-mode AI startup on a mission to revolutionize AI and data solutions. Headquartered in Hyderabad, we are a well-funded startup with a world-class team and a passion for innovation in AI, NLP, Computer Vision, and Speech Recognition.


We are looking for a highly motivated Data Engineer with 2 to 4 years of experience to join our team and work on cutting-edge projects in AI and big data technologies.


Role Overview:

As a Data Engineer , you will design, build, and optimize scalable data pipelines and platforms to support our AI-driven solutions. You’ll collaborate with cross-functional teams to enable real-time data processing and insights for enterprise-level applications.


Key Responsibilities:

  • Develop and maintain robust data pipelines using tools like PySpark , Kafka , and Airflow .
  • Design and optimize data workflows for high scalability and performance using Hadoop , HDFS , and Hive .
  • Integrate structured and unstructured data from diverse sources into a centralized platform.
  • Leverage big data technologies for real-time processing and streaming using Spark Streaming and Nifi .
  • Work on cloud-based platforms such as AWS , Azure , and GCP to deploy and monitor scalable data solutions.
  • Collaborate with AI/ML teams to deploy machine learning models using MLflow and integrate AI capabilities into data pipelines.
  • Automate and monitor workflows to ensure seamless operations using CI/CD pipelines , Kubernetes , and Docker .
  • Implement data validation, performance testing, and troubleshooting of large-scale datasets.
  • Prepare and share actionable insights through BI tools like Tableau and Grafana .


Required Skills and Qualifications:


  • Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related fields.
  • Experience: 2 to 4 years in data engineering roles, working with big data ecosystems.


Technical Proficiency:

  • Big Data Tools: Hadoop, HDFS, PySpark, Hive, Sqoop, Kafka, Spark Streaming, Airflow, Presto, Nifi.
  • Cloud Platforms: AWS (Glue, S3, EMR), Azure (ADF, HDInsight), GCP (BigQuery, Pub/Sub).
  • Programming Languages: Python, SQL, Scala.
  • DevOps & Automation: Jenkins, Ansible, Kubernetes, Docker.
  • Databases: MySQL, Oracle, HBase, Redis.
  • Visualization Tools: Tableau, Grafana, Zeppelin.
  • Knowledge of machine learning models, AI tools (e.g., TensorFlow, H2O), and feature engineering is a plus.
  • Strong problem-solving skills with attention to detail and ability to manage multiple projects.
  • Excellent communication and collaboration skills in a fast-paced environment.


What We Offer:

  • Opportunity to work on innovative AI projects with a global impact.
  • Collaborative work culture with access to cutting-edge technologies.

  • Data Engineer

    4 months ago

    Greater Hyderabad Area, India Circuitry.ai Full time

    Data Engineer Location: Hyderabad, India - Hybrid Remote (3 days a week in office preferred) Position Overview: As a Data Engineer focused on AI development, you will play a pivotal role in the design, development, and deployment of data infrastructure and pipelines that support artificial intelligence and machine learning initiatives within our...

  • Data Engineer

    4 months ago

    Greater Hyderabad Area, India Circuitry.ai Full time

    Data EngineerLocation: Hyderabad, India - Hybrid Remote (3 days a week in office preferred)Position Overview: As a Data Engineer focused on AI development, you will play a pivotal role in the design, development, and deployment of data infrastructure and pipelines that support artificial intelligence and machine learning initiatives within our organization....

  • Data Engineer

    1 month ago

    Greater Hyderabad Area, India Insight Global Full time

    JOB DESCRIPTIONOur Tech clients within the Data & Analytics (DNA) Organization is seeking two experienced Senior Data Engineers to join our team in India. These individuals will play a crucial role in building analytical data assets and leveraging the modern data stack to support a new program, the modernization of internal data estate and analytics. The...

  • Data Engineer

    6 days ago

    Greater Hyderabad Area, India Stealth AI Startup Full time

    About Us:Join our stealth-mode AI startup on a mission to revolutionize AI and data solutions. Headquartered in Hyderabad, we are a well-funded startup with a world-class team and a passion for innovation in AI, NLP, Computer Vision, and Speech Recognition.We are looking for a highly motivated Data Engineer with 2 to 4 years of experience to join our team...

  • Data Engineer

    3 weeks ago

    Greater Hyderabad Area, India SwankTek Inc. Full time

    Data EngineerReq exp. Level: 10YrsJob Location: Hyderabad (Onsite)Responsibilities•      Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.•      Collaborate with product and technology teams to design and validate the capabilities of the data...

  • Data Engineer

    3 weeks ago

    Greater Hyderabad Area, India SwankTek Inc. Full time

    Data Engineer Req exp. Level: 10Yrs Job Location: Hyderabad (Onsite) Responsibilities •      Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation. •      Collaborate with product and technology teams to design and validate the capabilities of the...

  • Data Engineer

    1 month ago

    Greater Bengaluru Area, India Capgemini Full time

    Location: PAN India Job Description (GCP Data Engineer): • Experience in GCP Data Engineering. • Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud. • Should have worked on handling big data. • Strong communication skills. • experience in Agile methodologies ETL, ELT skills, Data movement...

  • Data Engineer

    1 month ago

    Greater Bengaluru Area, India Capgemini Full time

    Location: PAN IndiaJob Description (GCP Data Engineer):• Experience in GCP Data Engineering.• Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud.• Should have worked on handling big data.• Strong communication skills.• experience in Agile methodologies ETL, ELT skills, Data movement skills, Data...

  • Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India Recro Full time

    Must-Have Skills & Qualifications:Bachelorʼs degree in Computer Science, Engineering, or a related field; Masterʼs degree preferred.•5+ years of experience in data engineering or a related role.•Proficiency in Apache Airflow for workflow scheduling and management.•Strong experience with Hadoop ecosystems, including HDFS, MapReduce, and...

  • Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India Recro Full time

    Must-Have Skills & Qualifications: Bachelorʼs degree in Computer Science, Engineering, or a related field; Masterʼs degree preferred.• 5+ years of experience in data engineering or a related role.• Proficiency in Apache Airflow for workflow scheduling and management.• Strong experience with Hadoop ecosystems, including HDFS, MapReduce, and Hive.•...

  • Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India S P A Enterprise Full time

    Hi, Job Title: Data Engineer (Permanent)Location: Bangalore and PuneJob Description:Required Skills:data engineers 6+ years’ experiencePython proficiency and it's data structures Libraries: NumPy, pandas, beautiful soup, selenium, pdfplumber, Requests etc. SQL programming DevOps AWS S3 and Azure data bricks

  • Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India S P A Enterprise Full time

    Hi, Job Title: Data Engineer (Permanent) Location: Bangalore and Pune Job Description: Required Skills: data engineers 6+ years’ experience Python proficiency and it's data structures Libraries: NumPy, pandas, beautiful soup, selenium, pdfplumber, Requests etc. SQL programming DevOps AWS S3 and Azure data bricks

  • Data Engineer

    2 months ago

    Greater Bengaluru Area, India Kratos Gamer Network Full time

    About KGeN: KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer...

  • Data Engineer

    2 months ago

    Greater Bengaluru Area, India Kratos Gamer Network Full time

    About KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...

  • Data Engineer

    4 weeks ago

    Greater Bengaluru Area, India LTIMindtree Full time

    Mandatory Skills : ETL + Azure Databricks + PythonRoles/Responsibilities:Creating testing procedures to evaluate the performance of the data engineering PipelinesBuilding Data validation pipeline that automate testing processesRunning the Data pipelines testing procedures to evaluate the data pipelinesDocumenting all testing proceduresReporting bugs and...

  • Azure Data Engineer

    1 month ago

    Greater Bengaluru Area, India Torry Harris Integration Solutions Full time

    Are you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level.As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...

  • Azure Data Engineer

    1 month ago

    Greater Bengaluru Area, India Torry Harris Integration Solutions Full time

    Are you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level. As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...

  • Senior Data Engineer

    2 months ago

    Greater Kolkata Area, India FinArb Consulting Full time

    Job Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...

  • Senior Data Engineer

    6 days ago

    Greater Bengaluru Area, India Apparel Group Full time

    Hello Everyone, I am currently seeking Data Engineer/Senior Data Engineer who will be part of Data science team and will be working from Bangalore office, this is urgent requirement so only apply if you can Join with short notice, @ Working as Data Engineer with current designation will be preferred, and maximum budget is upto 24lpa Experience needed is...

  • Senior Data Engineer

    6 days ago

    Greater Bengaluru Area, India Apparel Group Full time

    Hello Everyone,I am currently seeking Data Engineer/Senior Data Engineer who will be part of Data science team and will be working from Bangalore office, this is urgent requirement so only apply if you can Join with short notice, @ Working as Data Engineer with current designation will be preferred, and maximum budget is upto 24lpa Experience needed is...