Big Data Engineer

3 weeks ago

GurgaonGurugramBangalore, IN TCCS Full time

Client : Carelon Global Solutions

Notice Period : 20 days.

Job Description :

Minimum experience :

- Should have hands-on experience in Software development for at least 9 years.

- Should have hands-on experience in order to handle project work as Technical Lead for at least 2 yr.

- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.

- Create and maintain optimal data architecture pipeline.

- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements and implement data solutions.

- Strive for continuous improvement of code quality and development practices ensuring Data services are reliable and scalable.

- Collaborate with other data engineers, data Analysts across cross-functional teams and provide expert guidance to junior members on best practices for data engineering in AWS cloud.

- Perform root cause analysis on internal and external data, processes and share insights with different stakeholders using reporting and visualizations tools.

- Work on large datasets to meet functional and business requirements

- Experience across AWS cloud services to build scalable data pipelines and data engineering workflow

- Experience with S3, EC2, EMR, Lambda, Glue, Athena, Airflow, Redshift.

- Strong experience with SQL and Scala skills using Spark framework.

- Experience with enterprise Data warehousing implementations using Batch and real time systems.

- Expertise in working with efficient Data Models in a big data ecosystem.

- Experience with Docker/containerization, Knowledge of IAM roles, Policies, etc.

- Ability to learn fast and translate data into actionable results

- Excellent communication skills with onsite team and client stakeholders

- Interpersonal Management with GIC model experience in mid-to-large teams

- Analytical mindset with good problem-solving skills

- Knowledge of the Agile process

- Detailed-oriented with strong documentation and tracking skills

- View challenges as opportunities and offer potential solutions.

- Ask questions to understand stakeholder roles and needs with an open mind.

- Look for opportunities to create value for all stakeholders.

- Offer viable, alternative solutions to problems instead of only stating objections.

- Lead by example, modeling Carelon values in everything you do

- Anticipate how your actions will affect upstream and downstream departments, thinking more broadly and end-to-end.

- Train less experienced team members, either formally or informally, on work processes and industry knowledge

- Give timely, balanced, honest, and caring feedback to help develop others?

Primary Skill Set :

- Hands on experience on AWS and Bigdata Engineer.

- Experience with S3, EC2, EMR, Lambda, Glue, Athena, Airflow, Redshift.

- Strong experience with SQL and Scala skills using Spark framework.

- Experience with enterprise Data warehousing implementations using Batch and real time systems.

(ref:hirist.tech)

  • Publicis Sapient

    3 weeks ago

    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Big Data Developer

    2 months ago

    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

  • Big Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

  • Big Data Developer

    2 months ago

    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Senior Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Diatoz Solutions

    4 weeks ago

    Gurgaon/Gurugram, IN Diatoz Solutions Private Limited Full time

    Job Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...

  • Diatoz Solutions

    3 weeks ago

    Gurgaon/Gurugram, IN Diatoz Solutions Private Limited Full time

    Job Description :We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.Responsibilities :- Data Pipeline...

  • Publicis Sapient

    4 weeks ago

    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :Role : Data Engineer - Overall experience of 5.5 years with Minimum 4 years of relevant experience in Big Data technologies.- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. - Working...

  • Publicis Sapient

    3 weeks ago

    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :Role : Data Engineer - Overall experience of 5.5 years with Minimum 4 years of relevant experience in Big Data technologies.- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. - Working...

  • Diatoz Solutions

    4 weeks ago

    Gurgaon/Gurugram, IN DIATOZ Solutions Pvt ltd., Full time

    We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing :- Data Pipeline Development: Design, Develop, And Maintain...

  • Diatoz Solutions

    3 weeks ago

    Gurgaon/Gurugram, IN DIATOZ Solutions Pvt ltd., Full time

    We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team. The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing :- Data Pipeline Development: Design, Develop, And Maintain...

  • Publicis Sapient

    3 weeks ago

    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As a Senior Data Engineer, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to...

  • Publicis Sapient

    3 weeks ago

    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As a Senior Data Engineer, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to...

  • Impetus - Google Cloud Platform Engineer - Big Data Technologies

    3 weeks ago

    Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Qualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...

  • Impetus - Google Cloud Platform Engineer - Big Data Technologies

    2 months ago

    Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Qualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...

  • Big Data Engineer

    1 week ago

    Mumbai/Bangalore/Pune, IN Techno Wise Full time

    Job Role : Big Data EngineerRelevant Experience : 3+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a...

  • Senior Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Job Description :- Bigdata + Java: Java, Microservices, Springboot, API, Bigdata- Experience with design and coding across one or more platforms and languages (e.g. Java, Python/Spark/SQL) as appropriate.- Hands-on expertise with application design, software development and automated testing - Proficient in Big Data technologies Designs, codes, tests,...

  • Data Engineer

    2 months ago

    Gurgaon/Gurugram, IN Huquo Consulting Full time

    Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...