Current jobs related to Big Data Pipeline Developer Lead - Hyderabad, Telangana - Incedo Inc.

  • Big Data Engineer, Data Modeling

    2 weeks ago

    Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...

  • Big Data Engineer

    4 days ago

    Hyderabad, Telangana, India SMARTWORK IT SERVICES Full time

    Job Title : Big Data Engineer (Dynatrace)Location : Chennai, Bangalore, HyderabadExperience : 6-10 YearsRequired skills : Big Data, DynatraceJob Description : We are looking for an experienced Big Data Engineer (Dynatrace) with building scalable data pipelines and ensuring performance optimization through Dynatrace monitoring. This role requires a seasoned...

  • Big Data Engineer, Data Analysis

    2 weeks ago

    Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? "As a Data Analyst at data.ai, I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing...

  • Big Data Engineering Lead

    2 days ago

    Hyderabad, Telangana, India Talescope Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Talescope. As a key member of our engineering team, you will be responsible for leading the design and implementation of complex, scalable data pipelines using AWS services. You will work closely with cross-functional teams to understand their data needs and translate them...

  • Big data engineer

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Big data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...

  • Big Data Developer

    6 days ago

    Hyderabad, Telangana, India Kairos Konnect Full time

    About Kairos Konnect:We are a cutting-edge company that uses innovative technologies to drive business success. Our team is passionate about delivering high-quality solutions that exceed our customers' expectations.We are currently seeking a Big Data Developer to join our team. As a key member of our data platform, you will be responsible for designing and...

  • Lead - Big Data Developer

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Lead - Big Data Developer - CREQ189749 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong...

  • Big Data Developer Lead

    5 days ago

    Hyderabad, Telangana, India Cube Hub Inc. Full time

    Job Overview:Cube Hub Inc. is a leading provider of innovative data solutions. We are seeking a highly skilled Big Data Developer Lead to join our team.Key Responsibilities:Lead the design and development of large-scale data processing systems using Scala/Spark.Work closely with stakeholders to understand business needs and develop technical solutions.Mentor...

  • Data Pipeline Engineer

    2 days ago

    Hyderabad, Telangana, India algoleap Full time

    **Job Description**Our ideal candidate has strong experience with ETL/ELT pipelines, data integration, and big data technologies such as Kafka, Spark, and Hadoop. You will work closely with data analysts, developers, and DevOps teams to support data-driven solutions.- Ingest, transform, and distribute data across multiple sources such as databases, APIs,...

  • Big data Lead

    2 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Limited Full time

    Job DescriptionRole- Big data LeadJob DescriptionDesired Competencies (Technical/Behavioral Competency)- Big data- Spark- Scala- Project ManagementResponsibilities- Good experience in MQ or kafka or Rabbit MQ- Exp in .Terraform, Kubernete- CI/CD, Cloud- Good stakeholder management exp

  • Big Data Python Engineer

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Big Data Python Engineer - CREQ191701 Description Role GDT WS Big Data Python Engineer Exp 5+ Location Pune/Hyderabad MUST Have Skills Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark. Airflow Jenkins Understand business requirements to code up data assets...

  • Data Pipeline Specialist

    1 day ago

    Hyderabad, Telangana, India b4uleap Full time

    AWS Data Engineer RoleAs an AWS Data Engineer at b4uleap, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and decision-making.Key Responsibilities:-...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Folks Palette LLP Full time

    Job Description : We are seeking an experienced Big Data Engineer with PySpark Developer to join our dynamic team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data solutions in a big data ecosystem. The ideal candidate will have a strong background in big data technologies,...

  • Big Data Engineer Position

    3 days ago

    Hyderabad, Telangana, India Insight Global Full time

    Job DescriptionWe are seeking a highly skilled professional with a strong background in designing and implementing ETL data pipelines using Apache Spark and either Scala or Python. The ideal candidate will have a deep understanding of big data frameworks, advanced SQL skills, and hands-on experience with Elasticsearch. Key responsibilities include building...

  • Data Engineer for Scalable Data Pipelines

    5 days ago

    Hyderabad, Telangana, India CIEL HR Full time

    Job Description:As a Spark Engineer at CIEL HR, you will be responsible for designing and implementing high-performance data ingestion pipelines from multiple sources using Apache Spark. You will work closely with the project team to deliver scalable and reusable frameworks for ingesting geospatial data sets. Additionally, you will integrate end-to-end data...

  • Big Data Engineer Specialist

    21 hours ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Welcome to TATA CONSULTANCY SERVICES LIMITEDWe are seeking an experienced Big Data Engineer to join our team.About the Role:This is a senior-level position requiring 5-8 years of experience in designing and implementing big data solutions using Azure Databricks, Azure Data Factory, and Azure Synapse Analytics.Main Responsibilities:Lead the development of...

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India Apollo HealthAxis Full time

    Job DescriptionAs a Big Data Engineer at Apollo HealthAxis, you will be responsible for designing and implementing large-scale data processing systems using distributed computing technologies. You will work closely with cross-functional teams to understand business requirements and translate them into effective data architecture and...

  • AWS Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Tiger Analytics Full time

    Job Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Questsphere Private ltd. Full time

    Our client is looking to deploy big data engineer at one of the worlds top product company R&D centre based out of Hyderabad. As a Big Data Engineer, you are going to work with cross-functional collaboration and communication with members from other teams.As an Engineer, you are responsible to analyze large data sets to identify errors . You are responsible...

  • Big Data Solutions Developer

    4 days ago

    Hyderabad, Telangana, India Cognisol Full time

    About the Job:Cognisol is looking for a highly skilled Databricks engineer to join our team. As a Databricks engineer, you will be responsible for designing, developing and implementing big data solutions using Databricks and Apache Spark.Key Responsibilities:Design and develop big data solutions using Databricks and Apache SparkWork closely with...

Big Data Pipeline Developer Lead

1 week ago

Hyderabad, Telangana, India Incedo Inc. Full time
Job Description

Sr. Lead Data Engineer – Big Data

Overview

Incedo Inc. is a leading company in the data analytics space, and we are seeking a highly skilled Sr. Lead Data Engineer to lead our big data engineering efforts.

Key Responsibilities
  • Leverage strong technical, analytical, and problem-solving skills to design and develop large-scale data pipelines.
  • Collaborate with cross-functional teams to identify business requirements and develop solutions that meet those needs.
  • Lead the development of data pipeline frameworks using CDH On-premise for data processing and extraction.
  • Maintain and improve existing data pipelines to ensure high levels of performance and scalability.
  • Work closely with data scientists to ensure seamless integration of data pipelines with machine learning models.
Requirements
  • Strong proficiency in Hadoop, Hive, Python, Spark/PySpark, and other big data technologies.
  • Experience designing and building big data pipelines with CDH experience, Spark, PySpark, Scala, Python, NiFi, Hive, NoSql DBs.
  • Familiarity with ETL and Business Intelligence tools, as well as shell scripting for pipeline automation.
  • Agile methodologies and version control systems like git.
  • Excellent communication and presentation skills to effectively collaborate with stakeholders and communicate complex ideas.
Benefits

We offer a dynamic work environment, competitive salary, and opportunities for professional growth and development.