Big Data Pipeline Specialist

7 days ago


Chennai, Tamil Nadu, India Getinz Full time

Role Overview:

As a Big Data Pipeline Specialist at Getinz, you will play a critical role in ensuring the smooth operation of our data infrastructure. You will be responsible for designing, building, and maintaining complex data pipelines that integrate and transform data from various sources.

You will have the opportunity to work with a range of technologies, including relational databases, NoSQL databases, Apache Spark, and Kafka. In addition, you will collaborate with cross-functional teams to ensure that business requirements are met and that data is accurately integrated and transformed.

Responsibilities:

  • Design and develop data pipelines using a variety of technologies
  • Collaborate with cross-functional teams to gather and translate business requirements into technical solutions
  • Work with relational and NoSQL databases to manage and optimize large datasets
  • Utilize Apache Spark for distributed data processing and real-time analytics
  • Implement and manage Kafka for data streaming and real-time data integration

Requirements:

  • 5-8 years of experience in data engineering, with a focus on building and managing data pipelines
  • Strong proficiency in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra)
  • Experience in building data pipelines with data warehouses like Snowflake, Redshift
  • Hands-on experience with Kafka for real-time data streaming and messaging


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Company OverviewTata Consultancy Services (TCS) is a global leader in IT services and consulting.Job DescriptionWe are seeking an experienced Big Data Architect Specialist to join our team. As a Big Data Architect, you will be responsible for designing and administering data projects using Big Data services.Required Skills and QualificationsTechnical Skills:...


  • Chennai, Tamil Nadu, India DXC Luxoft Full time

    About the Role: We are seeking a seasoned Big Data Engineer to join our team at DXC Luxoft. As a Big Data Engineer, you will play a key role in designing and implementing scalable data architectures, developing high-performance data pipelines, and ensuring the quality of our analytics solutions.Key Responsibilities:Design and implement data pipelines using...


  • Chennai, Tamil Nadu, India Lapis Data Analytics Full time

    Join Our TeamLapis Data Analytics is a dynamic and growing company looking for talented professionals to join our team.We are committed to providing a positive and inclusive work environment that fosters creativity, innovation, and collaboration.About the JobThis is a full-time on-site Java Software Engineer role located in Chennai.The Software Engineer will...

  • Big Data Specialist

    6 days ago


    Chennai, Tamil Nadu, India Saaki Argus And Averil Consulting Full time

    At Saaki Argus And Averil Consulting, we are looking for a seasoned Big Data Specialist to join our team. This is an exciting opportunity for experienced professionals who have a strong background in designing and implementing large-scale data processing systems.The ideal candidate will have at least 7 years of experience working with big data technologies...


  • Chennai, Tamil Nadu, India Colan Infotech Full time

    About the RoleWe are hiring a skilled Azure Data Engineer to join our team at Colan Infotech. As a key member of our team, you will be responsible for designing, developing, and maintaining scalable data pipelines using various tools and technologies. If you have a passion for big data engineering and a strong background in programming skills, we encourage...


  • Chennai, Tamil Nadu, India Getinz Full time

    We are looking for a Senior Big Data Specialist to join our team at Getinz and lead the development of innovative data engineering solutions.About Getinz:At Getinz, we're passionate about leveraging big data to drive business success. We're seeking a seasoned professional with hands-on expertise in data engineering to join our team.Job...

  • Big Data Engineer

    5 days ago


    Chennai, Tamil Nadu, India Citigroup Full time

    Job DescriptionData Engineers play a crucial role in building scalable and efficient data engineering solutions at Citigroup. The ideal candidate will be responsible for designing and developing big data pipelines using next-generation techniques.Responsibilities:Collaborate with cross-functional teams to deliver data products and solutions.Design and...


  • Chennai, Tamil Nadu, India LTI - Larsen & Toubro Infotech Full time

    Job DescriptionGreetings from LTI Mindtree Skill. We are excited to announce the availability of a challenging role as a Big Data Technology Specialist.This position will be responsible for designing, developing, and implementing large-scale data processing systems using Java Spark.

  • Big Data Architect

    4 days ago


    Chennai, Tamil Nadu, India UST Full time

    About the Role:We are seeking an experienced DevOps Engineer to lead our big-data solutions team. As a key member of our dynamic team, you will design, develop, and maintain robust, scalable, and secure data pipelines and infrastructure for our big-data applications.Key Responsibilities:AWS Big-Data Solutions: Collaborate with cross-functional teams to...


  • Chennai, Tamil Nadu, India IntraEdge Full time

    Job Overview:IntraEdge is seeking an experienced Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems. Your expertise in big data technologies such as Py Spark, Kafka, and Oracle RDBMS will enable us to efficiently collect, process, and analyze...

  • Big Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India Saaki Argus & Averil Consulting Full time

    Key SkillsHands-on experience on technologies like Python, SQL, Snowflake, HDFS, Hive, Scala, Spark, AWS, HBase and Cassandra. Good knowledge in Data Warehousing concepts. Proficient in Hadoop distributions such as Cloudera, Hortonworks. Good working experience on technologies like Python, Scala, SQL & PL/SQL Developers design and build the foundational...

  • Big Data Developer

    2 weeks ago


    Chennai, Tamil Nadu, India Hrizen Techno Services Full time

    We are seeking an experienced Big Data Developer to join our dynamic team. The ideal candidate will have a strong background in big data technologies, data engineering, and distributed systems. This role requires expertise in handling large-scale data processing systems, ensuring data reliability, and driving data-driven : - Design, develop, and implement...


  • Chennai, Tamil Nadu, India TekPillar Services Pvt. Ltd Full time

    About TekPillar ServicesWe are a company that values innovation and expertise in the field of data engineering.Job DescriptionThe successful candidate will be responsible for designing and implementing efficient data pipelines, working closely with our cross-functional teams to ensure seamless integration.ResponsibilitiesDevelop high-quality data pipelines...

  • Big Data Engineer

    7 days ago


    Chennai, Tamil Nadu, India Risk Resources Full time

    Risk Resources is looking for a talented Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing and implementing scalable and efficient data systems that support business growth and innovation.About the JobWe are seeking an experienced big data developer who can work closely with data architects, data analysts, and...


  • Chennai, Tamil Nadu, India Saaki Argus and Averil Consulting Full time

    Job DescriptionWe are seeking an experienced Big Data Engineer to join our team at Saaki Argus and Averil Consulting. The ideal candidate will have a strong background in data engineering, with expertise in technologies such as Python, SQL, Snowflake, HDFS, Hive, Scala, Spark, and AWS or GCP.The successful candidate will be responsible for designing,...


  • Chennai, Tamil Nadu, India Synechron Full time

    Job SummaryWe are looking for a highly skilled Data Engineer to join our team at Synechron. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines using PySpark on Cloudera Data Platform (CDP). This role requires a strong background in big data ecosystems, cloud-native tools, and advanced data...

  • Big Data Developer

    7 days ago


    Chennai, Tamil Nadu, India Synechron Full time

    Position Review: We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will design, develop, and maintain scalable and efficient data processing systems using Java and Apache Spark. You will work closely with data scientists, analysts, and other engineering teams to implement data-driven...

  • Big Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Coders Brain Technology Private Limited Full time

    Job DescriptionMandatory skillset:1. Apacha Kafka or AWS kinesys.2. Elastic Search or AWS open Search.3. Apacha Spark or aws Glue.4. PythonWe are looking for a skilled and experienced Big Data Engineer with expertise in modern cloud-based technologies, specifically AWS services like Kinesis, Glue, Lambda, and Kafka. The ideal candidate will have hands-on...

  • Big Data Developer

    4 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign, develop, and deploy scalable Big Data applications using Hadoop ecosystem technologies (Hadoop, HDFS, Hive, etc.). Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement...

  • Big Data Developer

    6 days ago


    Chennai, Tamil Nadu, India Synechron Full time

    Position Review We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. Key Responsibilities: Design, develop, and maintain scalable and efficient data processing systems using Java and Apache Spark. Collaborate with data scientists, analysts, and engineering teams to implement data-driven solutions and optimize...