Senior Data Engineer- Spark/Python

1 month ago

Bengaluru, India iMind Your Business Solutions Private Limited Full time

We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).

Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business intelligence, and data discovery. They work with both corporate technology departments and corporate business units to develop value-added decision support solutions, not just new technology deployments.

Roles and responsibilities :

- Overall, 7+ years of experience with experience in Amazon Web Services, GCP, and Azure

- 4+ years of experience in Data engineering or related field in Architecting and developing end-to-end scalable data applications and data pipelines

- 3+ years of coding experience with modern programming or scripting languages (Python) and data processing packages and libraries

- 3+ years of hands-on experience in building big data solution using AWS Serverless, AWS Data storage and processing services, Aurora, Redshift, and Azure

- 2+ years of experience in advanced data modelling, SQL and query performance tuning skills

- Lead design, data strategy, road map exercises, and implementation

- Demonstrated strength and experience in data modeling, ETL development and data warehousing concepts

- Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes and testing

- Review code, provide recommendations, and act as the repo/technology repo owner.

- Excellent Communication skills is Mandatory

Years of Experience : 7-10 Years

Location : Anywhere in India

Education : BE, B.Tech, Any Tech Graduate

Must-Have Technical Skills : including 3+ years Spark or Scala,

- 2+ years of Hadoop/Big Data using tools like Hive, Spark, PySpark, Scala, and RDBMS/SQL Strongly

- Preferred: GCP, including GCS (Google Cloud Storage), Dataproc, and BigQuery

(ref:hirist.tech)

  • Senior Data Engineer

    1 month ago

    Bengaluru, India SPN Globe Full time

    Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB.Job Description :1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting capabilities...

  • Senior Azure Data Engineer

    1 month ago

    Bengaluru, India Trueblue HR Consultants Full time

    Position: Sr.Azure Data EngineerQualification: Bachelor of Engineer / Computer Science/ MCA / MS Comp Si + Overall 15-20 years experience with 5+ years experience in developing AI solutions.Willing to work with Start up Senior Data Engineers are responsible for delivering high quality modern data solutions through collaboration with our team and our...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India TalentPulse Consultant Full time

    Role : Big Data EngineerJob Description :We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis.The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala.This is an active position with a high priority, offering a competitive rate and the...

  • Evnek - Senior Data Engineer - Python/Spark

    1 month ago

    Bengaluru, India Evnek Technologies Full time

    Job Description :- Experience working with distributed technology tools for- developing Batch and Streaming- pipelines using SQL, Spark, Python, PySpark [4+ years], Airflow [3+ years], Scala [2+ years].- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for Managed Spark...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, India Kezan Consulting Full time

    Work Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Primary skillset :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python [6+ years], Airflow [4+ years], Scala [4+ years].- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming languages, technologies, and frameworks.- Strong skills building...

  • Azure Data Engineer

    1 week ago

    Bengaluru, India Smart Consulting - Creating Future Leaders Full time

    EARLY JOINERS WILL BE PREFERABLE. Company : BIG 4 MNC. Role : Azure Data Engineer. Location : Bangalore. Experience : 3-8 Years. CTC : 22 LPA Max (Depends on current CTC, experience, skills). Mandatory skills : Azure, Azure Cloud, Azure Databricks, Azure Datafactory, Azure Datalake, Python, SQL, Relational databases (Oracle, DB2, SQL Server), Spark, Agile....

  • Data Engineer

    4 weeks ago

    Bengaluru, India ADVANSOFT Full time

    Skills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and...

  • Spark Engineer

    2 weeks ago

    Bengaluru, India Cyber Sphere LLC Full time

    Job Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Capleo Global Full time

    Senior Data Engineer Experience: 7-9 years Location: Bengaluru Availability: Immediate to 30 days Mandatory Skills: Spark Databricks PySpark or Scala SQL & Python Github DWH (Snowflake or Presto or Hive or Hadoop) Data Pipeline & Data Model We are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Capleo Global Full time

    Senior Data EngineerExperience: 7-9 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:SparkDatabricksPySpark or ScalaSQL & PythonGithubDWH (Snowflake or Presto or Hive or Hadoop)Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about shaping the...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India Capleo Global Full time

    Senior Data EngineerExperience: 7-9 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:SparkDatabricksPySpark or ScalaSQL & PythonGithubDWH (Snowflake or Presto or Hive or Hadoop)Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about shaping the...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Capleo Global Full time

    Senior Data EngineerExperience: 7-9 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:1. Spark2. Databricks3. PySpark or Scala4. SQL & Python5. Github6. DWH (Snowflake or Presto or Hive or Hadoop)7. Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India CliqHR Full time

    Job Description :Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...

  • Azure Data Engineer

    1 month ago

    Bengaluru, India Pylon Management Consulting Full time

    Responsibilities:- Developing low to high complexity, secure, governed, high quality and efficient data pipelines from a variety of on and off premise, internal and external data source.- Ensuring that data is cleansed, mapped, transformed and optimised for storage to meet requirements for business and technical use cases.- Building data observability and...

  • Data Engineer II

    2 weeks ago

    Bengaluru, India Sourcingxpress Full time

    About the Company :Our client is a dynamic and rapidly growing company, recognized as one of India's leading kids fashion brands. We are currently seeking a passionate Data Engineer to join their team. Operating in a fast-paced startup environment, they collaborate across various teams including data analytics, marketing, data science, and individual...

  • Data Engineer

    1 month ago

    Bengaluru, India CliqHR Full time

    Mandatory Skills : - Microsoft Azure, Pyspark, Data Bricks, Hadoop, Spark, Airflow, KafkaRequirments :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using.- SQL, Spark, Python, Airflow, ScalaKafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...

  • Senior Data Engineer

    4 days ago

    Bengaluru, India Webologix Ltd INC Full time

    Job Position: Python Developer with Data EngineerJob Type: Full-TimeLocation: Delhi /Gurgaon/Hyderabad /Gujrat /BangaloreExperience: - 10+ YearsMust Have: Python, AWS Glue Data engineering tools - Spark, Databricks, Airflow, Apache NIFI.Responsibilities:- 8+ years of relevant work experience required.- 7+ years engineering Python.- 5+ years engineering SQL.-...

  • GCP Data Engineer

    6 days ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, IndiaPosted on: May 08, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESneed someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP).EXPERIENCE6-8...

  • GCP Data Engineer

    3 days ago

    Bengaluru, India Infogain Full time

    GCP Data Engineer (Senior) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, IndiaPosted on: May 14, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESneed someone with strong Java or Python along with exp in Sparkand ETL pipelines and has a good understanding of cloud concepts (AWS/GCP).EXPERIENCE6-8...