Senior Associate Big Data Engineer

1 week ago

india Suitable.AI Full time

Role Objective :

Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products

Roles & Responsibilities :

  • Sound knowledge in Spark architecture and distributed computing
  • Proficient in Spark - including RDD and Dataframes core functions, troubleshooting and performance tuning.
  • Good understanding in object-oriented concepts and hands on experience on Scala or on java with excellent programming logic and technique
  • Good in functional programming and OOPS concept either on Scala or Java
  • Good experience in SQL - should be able to write complex queries.
  • Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.
  • Able to mentor new members for onboarding to the project.
  • Understand the client requirement and able to design, develop from scratch and deliver
  • AWS cloud experience would be preferable.
  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3, etc. (preferred)
  • Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (preferred)
  • Experience in analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS(preferred)
  • Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.
  • Managing project timing, client expectations and meeting deadlines.
  • Should have played project and team management roles.
  • Facilitate meetings within the team on regular basis.
  • Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.
  • Optimization, maintenance, and support of pipelines.
  • Strong analytical and logical skills.
  • Ability to comfortably tackling new challenges and learn
Must have Skills :
  • Must have relevant Big Data experience of at least 3 years
  • Must have experience in Scala/Java. (Not Python or Pyspark)
  • Must have experience in Spark
  • AWS preferable/Any cloud
  • SQL (Intermediate to advanced level)
  • Object-Oriented Programming
  • Good knowledge on ETL/ELT processes and tools
Good to Have Skills:
  • AWS Certification
  • Basic knowledge of streaming
  • Knowledge on hive, Hadoop, Kafka, Streaming
  • Git/similar version control tool
  • Knowledge in CI/CD, Microservices

(ref:hirist.tech)

  • Data Engineer –

    4 weeks ago

    india HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • ParallelDots - Senior Data Engineer - Big Data Technologies

    1 week ago

    india Paralleldots Full time

    Job Description : As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and : - Lead the design,...

  • Big Data Engineer

    4 weeks ago

    india Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Sr Big Data Engineer

    2 weeks ago

    India Rackspace Full time

    About the Role: We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies, especially GCP. This role involves working in a remote environment,...

  • Lead Big Data Engineer

    2 weeks ago

    India Grownex HR Solution Full time

    Role : Lead Big Data Engineer Work Mode : Remote(5 Days working) The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate...

  • GCP Big data Engineer

    2 weeks ago

    india IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...

  • GCP Big data Engineer

    2 weeks ago

    India IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...

  • GCP Big data Engineer

    2 weeks ago

    India IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...

  • Big Data Engineer

    2 weeks ago

    India Careerfit Full time

    Job Title: Big Data Solutions EngineerAbout the Company: Our company is a leading tech firm specializing in innovative data solutions that empower businesses to make informed decisions.Responsibilities :Solution Design : Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and...

  • Big Data Engineer

    2 weeks ago

    india Programming.com Full time

    Job Title : Big Data EngineerLocation : RemoteAbout Us :We are a leading specializing in software development . Our team is dedicated to leveraging cutting-edge technologies to deliver scalable and efficient solutions to our clients globally.Role Overview :We are seeking a highly skilled Big Data Engineer with a strong background in designing and developing...

  • Senior Associate

    2 weeks ago

    India Publicis Sapient Full time

    Job Description :Role : Senior Associate Data Engineering Level 2In the role of Senior Associate L2 in Data Engineering, you'll be instrumental in translating client requirements into technical designs and implementing components for data engineering solutions. Your impact spans across data ingestion, integration, transformation, storage, computation...

  • Lead Big Data/Data Engineer

    1 week ago

    india TechTiv Software Solutions Full time

    The Opportunity : Digit88 development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate would be joining an existing team of outstanding data...

  • Big Data Engineer

    7 days ago

    india Cielo Talent Full time

    Client: IBM, This represents a direct and enduring opportunity within IBM, with Cielo as the primary recruitment partner. Title: Big Data Engineer Location: Hyderabad (Hybrid) Experience: 5 to 10 Years Must have skills: Big data, Scala(Mandatory), Hive, Hadoop, Spark and PySpark Required Technical and Professional Expertise: First and most important...

  • Big Data Solutions Engineer

    2 weeks ago

    India Gethyr Full time

    Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution for our clients. The candidate will work closely with the software development team, data scientists, and product managers to understand...

  • Data Engineer –

    2 weeks ago

    India HARMAN International Full time

    HARMAN's engineers and designers are creative, purposeful and agile. As part of this team, you'll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • ParallelDots - Senior Data Engineer - Big Data Technologies

    5 days ago

    Anywhere in India/Multiple Locations Paralleldots Full time

    Job Description : As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and : - Lead the design,...

  • ParallelDots - Senior Data Engineer - Big Data Technologies

    5 days ago

    Anywhere in India/Multiple Locations, IN Paralleldots Full time

    Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...

  • IICL - Senior Big Data Engineer - Spark/Apache Flink

    7 days ago

    india INTELLIGENCE INDIA.COM LIMITED Full time

    Job Description :Role : Senior Data Engineer (Flink + Spark + Kafka)- Minimum 7 years of experience- B.Sc. Of Computer Science or similar- Proficiency in programming languages Java, Python or R- Experience with design and development of ELT workflows and data pipelines for high-volume data systems.- Experience in Data Engineering and implementation of...

  • Big Data Engineer

    3 weeks ago

    india Evnek Technologies Pvt Ltd Full time

    Job Description This is a remote position. Duration:  6 MonthLocation:  RemoteTimings: Full Time (As per company timings)Notice Period: within 15 days or immediate joinerExperience: 4-6 Years   Responsibilities Create and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial...

  • Big Data Engineer

    2 weeks ago

    India ATech Full time

    Designation:BIG DATA ENGINEERJob Description:Your Role and Responsibilities: Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Design, build, optimize and support new and existing data models and ETL processes based on our clients...