Senior Data Engineer

4 weeks ago


india Randstad Full time

Job Description:

We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field.

The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations.

This role offers an exciting opportunity to work on cutting-edge projects, contribute to the design and architecture of applications, and collaborate closely with business users.

Key Responsibilities:

- Data Engineering: Hands-on experience in PySpark, including Dataframe core functions and Spark SQL, for data processing and analytics.

- SQL Databases: Proficiency in SQL databases to write queries of varying complexity for data retrieval and manipulation.

- Big Data Programming: Experience in Big Data programming for data transformation, aggregations, and analytics.

- Customer Communication: Excellent communication skills to interact effectively with customers and stakeholders.

- Analytical Skills: Strong analytical skills to understand complex data requirements and troubleshoot issues effectively.

- Design & Architecture: Contribute to the overall design and architecture of applications developed and deployed.

- Performance Tuning: Optimize application performance by tuning executor sizing, environmental parameters, code optimization, and partition tuning.

- Requirements Gathering: Interact with business users to understand their requirements and translate them into functional specifications.

- Project Implementation: Implement projects based on functional specifications, ensuring timely and accurate Bachelor's/Master's degree in Computer Science, Information Systems, or a related field.

- Minimum of 5+ years of experience in data engineering.

- Strong proficiency in PySpark, Python, Spark, and SQL.

- Experience with Big Data technologies and programming languages.

- Excellent communication and interpersonal skills.

- Strong analytical and problem-solving abilities.

Technical Skills & Competencies:

- Expertise in PySpark, Python, Spark, and SQL.

- Hands-on experience in Big Data programming and analytics.

- Ability to design and architect data solutions.

- Strong performance tuning skills.

- Excellent communication and collaboration skills.

- Detail-oriented with a focus on quality and accuracy.

(ref:hirist.tech)

  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...


  • India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Senior Data Engineer

    3 weeks ago


    India hunterAI Full time

    Company DescriptionJoin hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    3 weeks ago


    India hunterAI Full time

    Company Description Join hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...


  • india OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION:• Analyze and understand  data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data•...


  • India Accelerant Full time

    Job Type - ContractLocation- IndiaExperience - 8+ yearsNOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau.Role DescriptionThis is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering, including data...


  • india Accelerant Full time

    Job Type - Contract Location- India Experience - 8+ years NOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau. Role Description This is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering,...


  • india PrimEra Medical Technologies Full time

    Job Description: Senior Data Engineer About PrimEra: PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact. Position Overview: We are seeking a highly skilled...


  • india True Tech Professionals Full time

    Senior Data Engineer Location: Gurgaon (Hybrid Mode) Experience: 5 years and above. Immediate Joiners Preferred (Notice Period: 10 - 15 days) We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL....

  • Senior Data Engineer

    3 weeks ago


    india Next-Link Full time

    Job Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...


  • india K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Data Engineer

    2 weeks ago


    india INI8 LABS Full time

    Job Description: We are looking for an experienced Senior Azure Data Engineer to join our team. The successful candidate should have experience working with Data Architects, Analyst and Stakeholders to develop, maintain and test data platforms. Experience: Minimum 4+ yrs Experience with Azure(Azure data bricks, Azure data factory, PySpark) minimum of 4...

  • Senior Data Engineer

    2 weeks ago


    India SourceBae Full time

    Senior Data EngineerExp-6+YrsShift Time : 2 PM - 11 PMAs a Senior Data Engineer , you will: Design, Architect, and Develop solutions leveraging cloud big data technology to ingest,process and analyze large, disparate data sets to exceed business requirements Develop systems that ingest, cleanse and normalize diverse datasets, develop datapipelines from...

  • Senior Data Engineer

    2 weeks ago


    india SourceBae Full time

    Senior Data Engineer Exp-6+Yrs Shift Time : 2 PM - 11 PM As a Senior Data Engineer , you will:  Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements  Develop systems that ingest, cleanse and normalize diverse datasets, develop data...

  • Senior Data Engineer

    3 weeks ago


    india V3 Staffing Solutions India P Limited Full time

    We have this opening with the global company that is shaping the future of gaming through groundbreaking technology and unparalleled creativity. Senior Data Engineer (AWS): Crafting Efficient Data Pipelines for Cloud Platforms We're seeking a seasoned Senior Data Engineer with over 9 years of hands-on experience in crafting and implementing highly...

  • Senior Data Engineer

    1 month ago


    india Recro Full time

    Position: Senior Data Engineer Location: Bangalore Type: Full-Time Experience Level: 4.5+ years Job Description: We're building a high-performing data team and searching for a skilled and passionate Data Engineer to join us! You'll be responsible for designing, developing, and maintaining our data infrastructure, ensuring a steady flow of clean,...


  • india Lapis Data Analytics Full time

    Company Description Lapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Senior Data Engineer

    4 weeks ago


    india Tredence Inc. Full time

    Data Engineering - Associate Manager (6-10 Years) / Manager (10-14 Years) This position requires someone with good problem solving, business understanding and client presence. Overall professional experience of the candidate should be above 10 years. A minimum of 6 years of experience in leading and managing a client portfolio in Data Engineering space....


  • india Mopid Full time

    Senior Data Engineer Position Experience Range: 4-8 years Job Timing: This position is full-time Job Type: The role requires working in-office from our Hyderabad location. If you are passionate about leveraging data to drive business success, have a keen eye for detail, and are looking for an opportunity to bring your expertise to a vibrant team, we would...