Current jobs related to Senior Data Engineer- Spark/Python - Anywhere in IndiaMultiple LocationsBangaloreChennai - iMind Your Business Solutions Private Limited

  • Data Engineer

    4 months ago

    Anywhere in India/Multiple Locations Circuit Compilers Full time

    Job Description : - 5 to 8 years in the build release management, software configuration, design, development, and cloud implementation. - Data Engineer with expertise in Python, Scala, PySpark, AWS S3, Glue, Redshift, Lambda, DBT, Serverless, Snowflake, SQL, Datalake, and Data Pipeline. - Leveraged AWS Glue for data cataloging, ETL job orchestration, and...

  • Senior Data Engineer

    4 months ago

    Anywhere in India/Multiple Locations MindBrain Full time

    Company Description. MindBrain seamlessly integrates innovation, education, and strategic workforce solutions. As a dynamic software company, we shape the future of technology. With a focus on comprehensive IT and non-IT training, we nurture talent, empowering individuals to lead in a rapidly evolving landscape. Through strategic resource augmentation, we...

  • Senior Data Engineer

    3 months ago

    bangalore, India Web Idea Solution LLP Full time

    Senior Data Engineer Job Description : - Design and build reusable components, frameworks and libraries at scale to support analytics products. - Design and implement product features in collaboration with business and Technology stakeholders. - Anticipate, identify and solve issues concerning data management to improve data quality.- Clean, prepare...

  • Spark/Scala Developer

    3 months ago

    Anywhere in India/Multiple Locations Gama Advisory Services LLP Full time

    Overview :We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team. As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala. Your expertise in Big Data processing and Scala programming...

  • Senior Data Engineer

    7 days ago

    India Luxoft Full time

    Project Description:As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine...

  • Senior Data Engineer

    2 days ago

    Chennai, India Getinz Full time

    About the Role : We are looking for a highly skilled and motivated Senior Data Engineer to join our dynamic team. You will play a key role in designing, implementing, and optimizing data architectures and pipelines to support scalable data solutions for our business.Qualifications : - 5-8 years of experience in data engineering, with a focus on building and...

  • Big Data Engineer

    4 weeks ago

    Chennai, India a client of change leaders Full time

    Job Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...

  • Data Engineer

    2 months ago

    Chennai, India Cynosure Corporate Solutions Full time

    Job Requirements :- Participate in the customer's system design meetings and collect the functional/technical requirements.- Build up data pipelines for consumption by the Data Science team.- Experience with ETL process and tools.- Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and...

  • Data Architect

    4 months ago

    Anywhere in India/Multiple Locations/Bangalore SGS Technical Services Pvt. Ltd Full time

    Job Title : Data Architect Location : Bangalore, India Job Type : Full-Time Notice period : 0-15 days Job Description : Position Overview : The Senior Data Architect will be responsible for the strategic design, implementation, and management of high-quality, scalable data solutions. This role requires extensive experience in data architecture, data...

  • IICL - Senior Big Data Engineer - Spark/Apache Flink

    3 months ago

    india INTELLIGENCE INDIA.COM LIMITED Full time

    Job Description :Role : Senior Data Engineer (Flink + Spark + Kafka)- Minimum 7 years of experience- B.Sc. Of Computer Science or similar- Proficiency in programming languages Java, Python or R- Experience with design and development of ELT workflows and data pipelines for high-volume data systems.- Experience in Data Engineering and implementation of...

  • Data Engineer python, spark, Hadoop, big data

    5 days ago

    bangalore, India Prontoex Consulting Services Pvt Ltd Full time

    Client : Capgemini - Direct PayrollsLocation: BangaloreMax Budget : 3-4 Yrs : 12LPA / 4 -6 Yrs : 18LPATitle: Data Engineer with python, spark, Hadoop, big dataExp: 3 to 6 yrsData Engineerpython, spark, Hadoop, big dataExp: 3-6 YrJob Description:As a Data Engineer with expertise in PySpark, Databricks, and Microsoft Azure, you will beresponsible for...

  • Senior Data Engineer

    3 months ago

    bangalore, India Zyoin group Full time

    Key Accountabilities and Decision Ownership: - Data Pipeline Development: Develop and maintain robust data pipelines to ingest, transform, and deliver data from various sources to downstream systems, data lakes, and data warehouses. - Data Transformation: Perform data cleansing, enrichment, and transformation using Python, Spark, and SQL to ensure data...

  • Data Engineer

    4 months ago

    Hyderabad/Bangalore/Chennai, India SPG Consulting Solutions Pvt.Ltd Full time

    Job Description: Senior Data EngineerLocation: Hyderabad, Chennai, BangaloreExperience: 4 to 10 YearsPrimary Skills:- Hadoop- Spark (Mandatory)- ScalaSecondary Skills:- Python- SQLRole Summary/Purpose:The Senior Data Engineer will join our dynamic scrum teams to perform functional and system development for Hadoop applications as part of our Enterprise Data...

  • Data Engineer

    1 month ago

    Chennai, India TekPillar Full time

    Job Role : Data Engineer Experience : 3 to 5 YearsLocation : ChennaiKey Responsibilities :- Assemble and maintain large, complex data sets that meet business requirements.- Build and optimize processes for data transformation, data structures, metadata management, and workload management.- Lead the data team for a particular product, responsible for...

  • Big Data Engineer

    3 months ago

    bangalore, India Leinex Consulting Full time

    Job Description : Role : Bigdata EngineerRequirements : - 3+ Years of experience in Python, Pyspark, SQL is must.- 3+ years of software development experience with (HDFS, Spark, Sqoop, Hive, HQL, Spark, Scala, PySpark)- Experience using Scala/Java/Python, SQL, and shell scripting.- Experience in developing and tuning spark applications.- Excellent...

  • Data Engineer python, spark, Hadoop, big data

    6 days ago

    bangalore, India Prontoex Consulting Services Pvt Ltd Full time

    Client : Capgemini - Direct Payrolls Location: Bangalore Max Budget : 3-4 Yrs : 12LPA / 4 -6 Yrs : 18LPA Title: Data Engineer with python, spark, Hadoop, big data Exp: 3 to 6 yrs Data Engineer python, spark, Hadoop, big data Exp: 3-6 Yr Job Description: As a Data Engineer with expertise in PySpark, Databricks, and Microsoft Azure, you will be ...

  • AWS Data Engineer

    2 weeks ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    1 month ago

    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    1 month ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Data Engineer

    3 months ago

    Anywhere in India/Multiple Locations Gama Advisory Services LLP Full time

    Overview :We are looking for a highly skilled Data Engineer with extensive experience in ETL (Extract, Transform, Load) processes and PySpark to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines that support data transformation and processing needs. Your expertise in PySpark and...

Senior Data Engineer- Spark/Python

4 months ago

Anywhere in IndiaMultiple LocationsBangaloreChennai iMind Your Business Solutions Private Limited Full time

We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).

Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business intelligence, and data discovery. They work with both corporate technology departments and corporate business units to develop value-added decision support solutions, not just new technology deployments.

Roles and responsibilities :

- Overall, 7+ years of experience with experience in Amazon Web Services, GCP, and Azure

- 4+ years of experience in Data engineering or related field in Architecting and developing end-to-end scalable data applications and data pipelines

- 3+ years of coding experience with modern programming or scripting languages (Python) and data processing packages and libraries

- 3+ years of hands-on experience in building big data solution using AWS Serverless, AWS Data storage and processing services, Aurora, Redshift, and Azure

- 2+ years of experience in advanced data modelling, SQL and query performance tuning skills

- Lead design, data strategy, road map exercises, and implementation

- Demonstrated strength and experience in data modeling, ETL development and data warehousing concepts

- Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes and testing

- Review code, provide recommendations, and act as the repo/technology repo owner.

- Excellent Communication skills is Mandatory

Years of Experience : 7-10 Years

Location : Anywhere in India

Education : BE, B.Tech, Any Tech Graduate

Must-Have Technical Skills : including 3+ years Spark or Scala,

- 2+ years of Hadoop/Big Data using tools like Hive, Spark, PySpark, Scala, and RDBMS/SQL Strongly

- Preferred: GCP, including GCS (Google Cloud Storage), Dataproc, and BigQuery

(ref:hirist.tech)