15h Left: Associate Staff Engineer, Big Data Engineer

3 weeks ago

Gurgaon, Haryana, India Nagarro Full time
Job Description

Job description

REQUIREMENTS:

- Total experience 5+years.
- Hands on experience in Data Engineering, Data Lakes, Data Mesh, or Data Warehousing/ETL environments.
- Strong working knowledge in Python, SQL, Airflow and PySpark.
- Hands-on experience implementing projects applying SDLC practices.
- Hands on experience in building data pipelines and building data frameworks for unit testing, data lineage tracking, and automation.
- Experience with building and maintaining a cloud system.
- Familiarity with databases like DB2 and Teradata.
- Strong working knowledge in Apache Spark, Apache Kafka, Hadoop and MapReduce.
- Strong troubleshooting skills and ability to design for scalability and flexibility.
- Expertise in Spanner for high-availability, scalable database solutions.
- Knowledge of data governance and security practices in cloud-based environments.
- Problem-solving mindset with the ability to tackle complex data engineering challenges
- Familiar with containerization technologies (Docker/Kubernetes).
- Excellent communication and collaboration skills.

RESPONSIBILITIES:

- Writing and reviewing great quality code
- Understanding the clients business use cases and technical requirements and be able to convert them in to technical design which elegantly meets the requirements
- Mapping decisions with requirements and be able to translate the same to developers
- Identifying different solutions and being able to narrow down the best option that meets the clients requirements
- Defining guidelines and benchmarks for NFR considerations during project implementation
- Writing and reviewing design documents explaining overall architecture, framework, and high-level design of the application for the developers
- Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed
- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it
- Understanding and relating technology integration scenarios and applying these learnings in projects
- Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements

  • Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Infogain Full time

    Posted on August 17 2024ROLES RESPONSIBILITIESBig Data Engineer Senior As a Big Data Engineer Senior you will be responsible for designing and implementing complex big data solutions You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs You will also be responsible for...

  • Associate Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India NITS Solutions Full time

    Company Background : NITS Solutions is a boutique technology and marketing firm that specializes in leveraging big data to develop and execute dealership parts and service programs for automotive OEMs. Our proprietary business intelligence platforms demonstrate a niche expertise in automotive aftersales, while integrating machine learning and automation into...

  • Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Idyllic Services Pvt Ltd Full time

    Job Title : Big Data Engineer - ScalaExperience : 7 to 10Years (Minimum 3+ years in Scala)Notice Period : Immediate to 30 DaysRole Overview : We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track...

  • Data Scientist/Big Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Techmora Full time

    Job Description : Data Science / Big Data EngineerLocation : Gurgaon / PuneEmployment Type : Full-timeNotice Period : 30 DaysExperience : 4-6 YearsAbout the Role :We are seeking a skilled Data Science / Big Data Engineer with strong expertise in data wrangling, large-scale data processing, and advanced analytics. The ideal candidate will have hands-on...

  • Big Data Modernization Engineer

    3 weeks ago

    Gurgaon, Haryana, India Infosys Limited Full time

    Job Description- Engineer has to help Director in Modernization- Convert Talend jobs into PySpark or Data proc jobs- Big data skills- Good in written and verbal Communication- Good problem-solving skills and programming skills

  • Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India NITS Solutions Full time

    We have an urgent opening for Big Data Engineer role.Job Location - GurgaonExperience Required - 2 -6 YearsSkills :- Understand business needs & apply analytical concepts to generate actionable business insights/optimization models- Write Java coding for Spark- Write Python/SQL code- Write Scala coding for Spark- Converting hard and complex techniques as...

  • 15h Left) Senior Data Engineering Analyst

    3 weeks ago

    Gurgaon, Haryana, India Optum Full time

    Job DescriptionOptum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion,...

  • Associate Staff Engineer

    17 hours ago

    Gurgaon, Haryana, India Nagarro Softwares Pvt. Ltd Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Associate Staff Engineer, Golang Company Description We're Nagarro. We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world experts across 39 countries,...

  • Staff Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India ANSR Summit Consulting Full time

    Role and Responsibilities: Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes Contribute to the design and documentation of our data lake platform Partner with Sr staff on the development and maintenance of data governance policies and procedures that ensure data quality, accuracy,...

  • Staff Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India ANSR Summit Consulting Full time

    Role and Responsibilities: Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes Contribute to the design and documentation of our data lake platform Partner with Sr staff on the development and maintenance of data governance policies and procedures that ensure data quality, accuracy,...