Big Data Engineer

2 weeks ago


BangaloreChennaiPuneTrivandrumThiruvananthapuram, India Tata Elxsi Full time

Job Description :


- At least 4+ years of experience pyspark framework.

- Good experience writing complex SQL and No SQL databases.

- Excellent coding and design skills, particularly in Pyspark and Python.

- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).

- Experience in AWS technologies such as EC2, Redshift, Cloud formation, EMR, AWS S3, AWS.

- Experience designing and implementing data pipelines in a onprem/cloud environment is required.

- Experience building/implementing data pipelines using Databricks/On prem or similar cloud database.

- Expert level knowledge of using SQL to write complex, highly optimized queries across large volumes of data.

- Hands-on object-oriented programming experience using Python is required.

- Professional work experience building real-time data streams using Spark and Experience in Spark.

- AWS certification is preferable: AWS Developer/Architect/DevOps/Big Data

(ref:hirist.tech)
  • Big Data Engineer

    4 weeks ago


    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible Job DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Big Data Engineer

    5 days ago


    pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    2 weeks ago


    Bangalore/Chennai/Pune/Trivandrum/Thiruvananthapuram, IN Tata Elxsi Full time

    Job Description : - At least 4+ years of experience pyspark framework.- Good experience writing complex SQL and No SQL databases.- Excellent coding and design skills, particularly in Pyspark and Python.- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).- Experience in AWS...

  • Big Data Engineer

    5 days ago


    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    5 days ago


    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    5 days ago


    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...


  • Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Senior Data Engineer

    4 weeks ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...


  • pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...


  • pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...

  • Big Data Engineer

    3 weeks ago


    Bangalore/Chennai/Pune, IN ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...

  • Big Data Engineer

    3 weeks ago


    Bangalore,Chennai,Pune, India ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases...


  • Pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...


  • Pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...


  • Pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...


  • Pune, India Qualys Full time

    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will...

  • Big Data Engineer

    4 weeks ago


    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    4 weeks ago


    bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...


  • Bangalore/Pune, IN Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...


  • Bangalore/Pune, India Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...