Data engineer With Spark

4 weeks ago

Bengaluru, Karnataka, India People Prime Worldwide Full time
About Client:

Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation. It partners with major firms in banking, healthcare, telecom, and media.

Our Client is known for combining deep industry expertise with agile development practices, enabling scalable and cost-effective digital transformation. The company operates in over 50 locations across more than 25 countries, has delivery centers in Asia, Europe, and North America and is backed by Baring Private Equity Asia.

Job Title : Data Engineer With Python,Spark

Key Skills : Data Engineer , Python , SQL , Spark

Job Locations : Bengaluru

Experience : 6 - 8

Education Qualification : Any Graduation

Work Mode : Hybrid

Employment Type : Contract

Notice Period : Immediate - 10 Days

Payroll : people prime Worldwide

Job description:

Skills : Data Engineer , Python , SQL , Spark

Responsibilities:

Analyze and organize raw data

Interpret trends and patterns

Conduct complex data analysis and report on results

Prepare data for prescriptive and predictive modeling

Combine raw information from different sources

Explore ways to enhance data quality and reliability

Identify opportunities for data acquisition

Develop analytical tools and programs

Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.

Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.

Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

Writes unit/integration tests, contributes to engineering wiki, and documents work.

Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.

Works closely with a team of frontend and backend engineers, product managers, and analysts.

Defines company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models.

Designs data integrations and data quality framework.

Designs and evaluates open source and vendor tools for data lineage.

Requirements and skills

Previous experience as a data engineer or in a similar role

Technical expertise with data models, data mining, and segmentation techniques

Knowledge of programming languages (e.g. Java and Python)

Hands-on experience with SQL database design

Great numerical and analytical skills

Notice : Immediate - 10 Days

Note: As this position is client specific position, as per above confirmed details we will proceed your candidature to next levels and will be offered same and no deviations on CTC and work location. If any such case, we will drop the candidature at that level and will not be considered further.

Note: Can you share me your updated resume to process the profile.

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineer (Spark & PySpark)About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark and Python.Your primary focus will be on developing and...

  • Data engineer With Spark

    2 weeks ago

    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...

  • Big Data Engineer – Spark

    2 days ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time

    Big Data Engineer – Spark & AnalyticsJob Description• Gather operational intel on business processes and policies from multiple sources• Prepare periodical and ad-hoc reports using operational data• Develop semantic core to align data with business processes• Support operations team's work streams for data processing, analysis and reporting•...

  • Big Data Engineer – Spark

    5 days ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time

    Big Data Engineer – Spark & Analytics Job Description • Gather operational intel on business processes and policies from multiple sources • Prepare periodical and ad-hoc reports using operational data • Develop semantic core to align data with business processes • Support operations team's work streams for data processing, analysis and reporting...

  • Big Data Engineer – Spark

    2 days ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Big Data Engineer – Spark & AnalyticsLocation- ( Bangalore, Maharashtra)Job Description•Gather operational intel on business processes and policies from multiple sources•Prepare periodical and ad-hoc reports using operational data•Develop semantic core to align data with business processes•Support operations team's work streams for data processing,...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India beBeeSparkExpert Full time ₹ 1,04,000 - ₹ 1,30,878

    A Spark Expert is required to drive business growth through innovative data processing and analysis. This role will focus on delivering scalable solutions using Apache Spark, ensuring high performance and reliability in a complex distributed computing environment.Key Responsibilities:Develop and implement large-scale data processing pipelines using Spark...

  • Apache Spark Data Processing Specialist

    18 hours ago

    Bengaluru, Karnataka, India beBeeDataProcessing Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Title: Apache Spark Data Processing SpecialistWe are seeking a skilled Apache Spark developer to join our team. The ideal candidate will possess expertise in designing, developing, and maintaining large-scale data processing applications using Apache Spark and related big data technologies.Key Responsibilities:Assist in creating efficient batch and...

  • EMR _ Spark SME

    4 weeks ago

    Bengaluru, Karnataka, India Unitforce Technologies Consulting Full time

    Job DescriptionTechnical Skills:- 5+ years of experience in big data technologies with hands-on expertise in AWS EMR and Apache Spark.- Proficiency in Spark Core, Spark SQL, and Spark Streaming for large-scale data processing.- Strong experience with data formats (Parquet, Avro, JSON) and data storage solutions (Amazon S3, HDFS).- Solid understanding of...

  • Big Data Engineer

    13 hours ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Data ArchitectDevelop and implement large-scale data architectures using Scala and Spark to drive business growth and efficiency.Key Responsibilities:Design and develop complex data processing systems using Scala, Spark, and distributed computing frameworks.Collaborate with cross-functional teams to integrate data processing systems with existing...

  • Studios - Data Engineer - Hive/Spark

    2 days ago

    Bengaluru, Karnataka, India CAW Full time US$ 90,000 - US$ 1,20,000 per year

    Job DescriptionWe are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The right...