Big Data Engineer

4 weeks ago


Chennai, India ADVANSOFT Full time

We are hiring for Data engineer with top most MNC client;

Exp : 5+years

Np : immediate to 15days

Location : & Responsibilities :


- 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.

- Experience working with Databases like Oracle, and Netezza and have strong SQL knowledge.

- Developing scalable streaming solutions based on Hadoop/ Big Data stack such as HDFS, Ozone, Hive/ Impala, Apache Spark, and Kafka.

- Experience in Data Engineering and implementation. multiple e end-to-end DW projects in a Big Data environment.

- Experience in building data pipelines through Git, Shell, Spark with Java/ Python on Hadoop, or Object storage (S3/CEPH).

- Strong analytical skills are required for debugging production issues, providing root causes, and implementing mitigation plans.

- Strong communication skills, both verbal and written and strong relationship, collaboration skills, and organizational skills.

- Flexible enough to stretch and work in India time to coordinate with the India team.

Experiences :

- Nice to have development experience in Python-based Al/ML workloads on Hadoop.

- Experience working on Nifi, APLS, and Unix Environments will be an added advantage.

- Experience of working in Agile teams.

- Ability to multi-task across multiple projects, interface with external and internal resources, and provide technical leadership to junior team members.

- Ability to be high-energy, detail-oriented, proactive, and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results.

- Ability to quickly learn and implement new technologies and perform POC to explore the best solution for the problem statement.

- Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.

- Perform assigned tasks and production incidents independently.

(ref:hirist.tech)
  • Big data Manager

    3 days ago


    Chennai, Tamil Nadu, India timesjobs Full time

    JOB DETAILSExperience in Big Data technologies and working exposure in at least one cloud platform on related data services (AWS / Azure / GCP)Hands-on experience with the Hadoop stack HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline.Excellent...

  • Big data Manager

    3 days ago


    Chennai, India timesjobs Full time

    JOB DETAILS1.Experience in Big Data technologies and working exposure in at least one cloud platform on related data services (AWS / Azure / GCP)2.Hands-on experience with the Hadoop stack HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data...

  • Big Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies. Experience working with Databases like...

  • Big Data Engineer

    3 weeks ago


    Chennai, India NucleusTeq Full time

      We are Hiring for Big Data Engineer at Nucleusteq !!!        Experience - 5-8 years        Locations- Multiple ( Bangalore, Raipur , Indore , )       Role Requirements :- Profound programming language experience in Java/Scala or Python.Knowledge of Hadoop ecosystem and strong hands-on experience on...

  • Big Data Engineer

    2 weeks ago


    chennai, India NucleusTeq Full time

      We are Hiring for Big Data Engineer at Nucleusteq !!!        Experience -  5-8 years        Locations-  Multiple ( Bangalore, Raipur , Indore , )       Role Requirements :- Profound programming language experience in Java/Scala or Python. Knowledge of Hadoop ecosystem and strong hands-on...

  • Manager (Big Data)

    4 weeks ago


    Chennai, India Databricks Full time

    CSQ325R53As aBig Data Managerin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...

  • Big Data Architect

    4 weeks ago


    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Data Engineer

    4 weeks ago


    Chennai, India Hiring Infinity Full time

    Role : Data EngineerWe are looking for a curious Data Engineer to join our extremely fast growing Tech Team About the organization :Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds.Businesses can manage ads across channels like Facebook, Instagram, Google and WhatsApp in a single platform.Proprietary...

  • Data Engineer

    1 week ago


    chennai, India Hiring Infinity Full time

    Role : Data EngineerWe are looking for a curious Data Engineer to join our extremely fast growing Tech Team About the organization :Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds.Businesses can manage ads across channels like Facebook, Instagram, Google and WhatsApp in a single platform.Proprietary...

  • Data Engineer

    4 weeks ago


    Chennai, India Hiring Infinity Full time

    Role : Data EngineerWe are looking for a curious Data Engineer to join our extremely fast growing Tech Team About the organization :Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds.Businesses can manage ads across channels like Facebook, Instagram, Google and WhatsApp in a single platform.Proprietary...

  • Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India Hiring Infinity Full time

    Role : Data EngineerWe are looking for a curious Data Engineer to join our extremely fast growing Tech Team About the organization :Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds.Businesses can manage ads across channels like Facebook, Instagram, Google and WhatsApp in a single platform.Proprietary...

  • Manager (Big Data)

    2 weeks ago


    Chennai, Tamil Nadu, India Databricks Full time

    CSQ325R53As aBig Data Managerin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...

  • Big Data Architect

    4 weeks ago


    Chennai, India Databricks Full time

    CSQ125R88As anArchitect (Big Data)in our Professional Services team you will work with clients on short to medium term customer engagements on theirBig Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...

  • Architect - Big Data

    2 weeks ago


    Chennai, Tamil Nadu, India Databricks Full time

    CSQ125R88As anArchitect (Big Data)in our Professional Services team you will work with clients on short to medium term customer engagements on theirBig Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...

  • Manager (Big Data)

    4 weeks ago


    Chennai, India Databricks Full time

    CSQ325R53As a Big Data Manager in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks...

  • Manager (Big Data)

    4 weeks ago


    chennai, India Databricks Full time

    CSQ325R53 As a Big Data Manager  in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...

  • Big Data Architect

    4 weeks ago


    chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...

  • Big Data Developer

    1 week ago


    Chennai, India Sadup Softech Full time

    Job Position: BIG DATA DEVELOPERLocation: ChennaiExp: 6+ YearsMust Have SkillsSpark-SQL, Scala, Spark, SQL, HiveBachelors/Masters in Engineering, Computer Science, or equivalent experience7+ years of experience in the IT industry, experience in Data space is preferred.Advanced scripting experienceExpertise in Hadoop, Spark, Spark-sql ,sql, ScalaKnowledge of...

  • Architect , Big Data

    4 weeks ago


    Chennai, India Databricks Full time

    CSQ225R24As aResident Solutions Architectin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Architect

    4 weeks ago


    Chennai, India Databricks Full time

    CSQ125R88As an Architect (Big Data) in our Professional Services team you will work with clients on short to medium term customer engagements on their Big Data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...