Senior Data Engineer- Spark/Python

2 months ago

Anywhere in IndiaMultiple LocationsBangaloreChennai iMind Your Business Solutions Private Limited Full time

We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).

Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business intelligence, and data discovery. They work with both corporate technology departments and corporate business units to develop value-added decision support solutions, not just new technology deployments.

Roles and responsibilities :

- Overall, 7+ years of experience with experience in Amazon Web Services, GCP, and Azure

- 4+ years of experience in Data engineering or related field in Architecting and developing end-to-end scalable data applications and data pipelines

- 3+ years of coding experience with modern programming or scripting languages (Python) and data processing packages and libraries

- 3+ years of hands-on experience in building big data solution using AWS Serverless, AWS Data storage and processing services, Aurora, Redshift, and Azure

- 2+ years of experience in advanced data modelling, SQL and query performance tuning skills

- Lead design, data strategy, road map exercises, and implementation

- Demonstrated strength and experience in data modeling, ETL development and data warehousing concepts

- Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes and testing

- Review code, provide recommendations, and act as the repo/technology repo owner.

- Excellent Communication skills is Mandatory

Years of Experience : 7-10 Years

Location : Anywhere in India

Education : BE, B.Tech, Any Tech Graduate

Must-Have Technical Skills : including 3+ years Spark or Scala,

- 2+ years of Hadoop/Big Data using tools like Hive, Spark, PySpark, Scala, and RDBMS/SQL Strongly

- Preferred: GCP, including GCS (Google Cloud Storage), Dataproc, and BigQuery

(ref:hirist.tech)

  • Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations Paralleldots Full time

    Job Description : As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and : - Lead the design,...

  • Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations, IN Paralleldots Full time

    Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...

  • Senior Data Engineer- Spark/Python

    1 week ago

    Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Senior Data Engineer- Spark/Python

    7 days ago

    Anywhere in India/Multiple Locations/Bangalore/Chennai iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Senior Data Engineer- Spark/Python

    2 months ago

    Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Data Engineer

    6 days ago

    Anywhere in India/Multiple Locations, IN Shankheshwar Enterprises Full time

    Our client is a leading player in the Digital Transformation space have 17 centers in USA and IndiaJob Description :- Analyze and organize raw data, developing and maintaining data systems and pipelines, and collaborating closely with data scientists and business analysts to ensure data quality and reliability.- Quickly grasp and translate business...

  • Data Engineer

    5 days ago

    Anywhere in India/Multiple Locations Shankheshwar Enterprises Full time

    Our client is a leading player in the Digital Transformation space have 17 centers in USA and India Job Description : - Analyze and organize raw data, developing and maintaining data systems and pipelines, and collaborating closely with data scientists and business analysts to ensure data quality and reliability. - Quickly grasp and translate business...

  • Data Engineer

    4 days ago

    Metros/Anywhere in India/Multiple Locations, IN WEN Full time

    Role : Data Engineer - Spark StreamingExperience : 5+ yearsResponsibilities :- Develop and maintain real-time data pipelines using Spark Streaming.- Collaborate with cross-functional teams to understand and define data requirements for streaming applications.- Design and implement scalable and efficient data processing solutions using Python and Pyspark.-...

  • Data Engineer

    4 days ago

    Metros/Anywhere in India/Multiple Locations WEN Full time

    Role : Data Engineer - Spark StreamingExperience : 5+ yearsResponsibilities :- Develop and maintain real-time data pipelines using Spark Streaming.- Collaborate with cross-functional teams to understand and define data requirements for streaming applications.- Design and implement scalable and efficient data processing solutions using Python and Pyspark.-...

  • Senior Python Developer

    1 month ago

    Anywhere in India/Multiple Locations Varite Full time

    Salary : 12-20 LPA Responsibilities : Develop pipeline objects using PySpark, Flink, Apache Spark, and Scala. Design and implement real-time data streams utilizing Flink and PySpark. Utilize AWS services such as Glue, EMR, and VPC for infrastructure management and deployment. Design and develop data pipeline architectures using Confluent Kafka, Spark,...

  • Senior Python Developer

    7 days ago

    Anywhere in India/Multiple Locations Varite Full time

    Salary : 12-20 LPA Responsibilities : Develop pipeline objects using PySpark, Flink, Apache Spark, and Scala. Design and implement real-time data streams utilizing Flink and PySpark. Utilize AWS services such as Glue, EMR, and VPC for infrastructure management and deployment. Design and develop data pipeline architectures using Confluent Kafka, Spark,...

  • Senior Data Engineer

    2 weeks ago

    Bangalore/Anywhere in India/Multiple Locations Blinkhealth Full time

    Company Overview : Blink Health is a healthcare technology company that builds products to make prescriptions accessible and affordable to everybody. Our two primary products - BlinkRx and Quick Save - remove traditional roadblocks within the current prescription supply chain, resulting in better access to critical medications and improved health outcomes...

  • Senior Data Engineer

    7 days ago

    Bangalore/Anywhere in India/Multiple Locations Blinkhealth Full time

    Company Overview : Blink Health is a healthcare technology company that builds products to make prescriptions accessible and affordable to everybody. Our two primary products - BlinkRx and Quick Save - remove traditional roadblocks within the current prescription supply chain, resulting in better access to critical medications and improved health outcomes...

  • Lead Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations SeaCross Recruitment Services Full time

    Job Description : - Ability to support the development of infrastructural components of the LDH stack- Strong coding experience and knowledge of cloud infrastructure, expertise in Python, Spark, SQL (Postgres)- Strong expertise in Azure, Databricks, Gen2 Storage, Terraform- Strong experience working with restful APIs and Event-Driven Architecture - Pub/Sub...

  • Lead Data Engineer

    1 week ago

    Anywhere in India/Multiple Locations, IN SeaCross Recruitment Services Full time

    Job Description :- Ability to support the development of infrastructural components of the LDH stack- Strong coding experience and knowledge of cloud infrastructure, expertise in Python, Spark, SQL (Postgres)- Strong expertise in Azure, Databricks, Gen2 Storage, Terraform- Strong experience working with restful APIs and Event-Driven Architecture - Pub/Sub or...

  • Lead Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations, IN SeaCross Recruitment Services Full time

    Job Description :- Ability to support the development of infrastructural components of the LDH stack- Strong coding experience and knowledge of cloud infrastructure, expertise in Python, Spark, SQL (Postgres)- Strong expertise in Azure, Databricks, Gen2 Storage, Terraform- Strong experience working with restful APIs and Event-Driven Architecture - Pub/Sub or...

  • Lead Data Engineer

    7 days ago

    Anywhere in India/Multiple Locations SeaCross Recruitment Services Full time

    Job Description : - Ability to support the development of infrastructural components of the LDH stack- Strong coding experience and knowledge of cloud infrastructure, expertise in Python, Spark, SQL (Postgres)- Strong expertise in Azure, Databricks, Gen2 Storage, Terraform- Strong experience working with restful APIs and Event-Driven Architecture - Pub/Sub...

  • Senior Spark Developer

    2 months ago

    Bangalore,Anywhere in India,Multiple Locations CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    About the job :Job Description / Duties & Responsibilities :- Develop, program, and maintain applications using the Apache Spark open-source framework.- Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming.- Spark Developer must have strong programming skills in Java, Scala, or Python.- Familiar with...

  • Lead Data Engineer

    5 days ago

    Anywhere in India/Multiple Locations UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Responsibilities for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to...

  • Senior Data Engineer

    2 months ago

    Bangalore, India SPN Globe Full time

    Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB. Job Description : 1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting...