Eminds.ai - Big Data Engineer - Spark/Python

3 weeks ago


Pune, India Enterprise Minds, Inc Full time

Job Description :


Mandatory Skills & Experience :

- Strong GCP, Expertise in Apache Spark, Airflow, Python experience, SQL.

- Good understanding of Hadoop eco-system and Hive.

- Exceptional troubleshooting skills in the following: GCP, Spark, Big Query, Python, DataProc, CICD.

- Construct and maintain ELT/ETL job processes sourcing from disparate systems throughout the enterprise and load into an enterprise data lake.

- Effectively acquire and translate user requirements into technical specifications to develop automated data pipelines to satisfy business demand.

- Comprehensive understanding of modern data architecture and enterprise data management frameworks, concepts, and best practices.

- Understanding on Data vault modeling and GitLab CICD is a plus.

Desired Skills & Experience :

- Candidate should be able to design the application architectures with GCP services.

- PySpark, Airflow, Big Query, Strong SQL understanding

- Good understanding of Docker, Kubernetes and streaming frameworks like Kafka or Pub/Sub.

- Good understanding of CICD process and troubleshooting

- Agile

(ref:hirist.tech)
  • Big Data Engineer

    4 days ago


    Pune, India Enterprise Minds, Inc Full time

    Hi Folks, Greetings from Enterprise MInds!! We‘re thrilled to announce an exciting opportunity to join our dynamic team at Enterprise Minds. We are on the lookout for a passionate and talented ‘GCP Data Engineer‘ About us: Enterprise Minds India is a Product Engineering company headquartered in San Francisco, In India Bangalore. Hyderabad and Pune,...


  • Pune, India Enterprise Minds, Inc Full time

    Hi Folks,Greetings from Enterprise MInds!!We're thrilled to announce an exciting opportunity to join our dynamic team at Enterprise Minds. We are on the lookout for a passionate and talented "GCP Data Engineer"About us:Enterprise Minds India is a Product Engineering company headquartered in San Francisco, In India Bangalore. Hyderabad and Pune, Tirupati,...


  • Pune, India Enterprise Minds, Inc Full time

    Hi Folks,Greetings from Enterprise MInds!!We're thrilled to announce an exciting opportunity to join our dynamic team at Enterprise Minds. We are on the lookout for a passionate and talented "GCP Data Engineer"About us:Enterprise Minds India is a Product Engineering company headquartered in San Francisco, In India Bangalore. Hyderabad and Pune, Tirupati,...

  • Aws and Big Data

    4 weeks ago


    Pune, India WUElev8 Innovation Services Full time

    **Invite Your Friend** - Invite **Share on** **Posted on** - 07/25/2023, 03:38:06 AM - **Applications** **AWS and Big Data (Scala & Spark)** - DataVerze Full Time 15 days Notice period acceptable 5 vacancies AWS Big Data Spark scala EC2 S3 EMR Java Python 12 to 45 LPA 4 to 12 Years Pune, Maharashtra - Job Description- Skills Required- Company DetailsWe...

  • Big Data Engineer

    1 month ago


    Bangalore,Chennai,Pune, India ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases...

  • Big Data Engineer

    1 month ago


    Bangalore/Chennai/Pune, IN ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...


  • Pune, India Huquo Full time

    Job Description :Must Have :Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.-...


  • Pune, India Huquo Full time

    Job Description : Must Have :Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.-...


  • Pune, Maharashtra, India Huquo Full time

    Job Description :Must Have :Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.-...

  • Senior Data Engineer

    1 month ago


    Bangalore,Kolkata,Pune, India Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Senior Data Engineer

    1 month ago


    Bangalore/Kolkata/Pune, IN Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Big Data Engineer

    2 months ago


    Pune, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...

  • Databricks Engineer

    1 week ago


    Pune, India Prometheus Consulting Full time

    Role : Databricks Engineer.Experience Required : 6 To 10 years.Location : Experience Required : ML Engineer with STRONG Databricks experience, Spark, Python, SQLAbout the Role :Are you a passionate Databricks engineer looking to join a top MNC and revolutionize the way data is processed and analyzed? We are searching for a talented individual to design,...

  • Big Data Engineer

    5 days ago


    Pune, India K-RY Tech Advisory Full time

    Requirements:Should haveminimum 3 years of experience on working Big DatatechnologiesGood Programmingskills.Hands on Experience in AutomatingBackend Applications (e.g. db REST API s)Handson experience with Automating any backend applications (e.g dbserver side).Knowledge of relational databasesand SQLGood debuggingskills.Strong working experience working...

  • Big Data Engineer

    4 days ago


    pune, India K-RY Tech Advisory Full time

    Requirements:Should haveminimum 3 years of experience on working Big Datatechnologies Good Programmingskills. Hands on Experience in AutomatingBackend Applications (e.g. db REST API s) Handson experience with Automating any backend applications (e.g dbserver side). Knowledge of relational databasesand SQL Good debuggingskills. Strong working experience...


  • Pune, India Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

  • AI/ML Engineer

    2 months ago


    Pune, India ARR Recruitment Solutions Full time

    We are seeking a highly skilled Senior AI/ML Engineer with extensive experience in data integration, data processing, and building applications that handle large-scale data in the order of Terabytes from multiple sources. The ideal candidate will possess strong programming skills, particularly in Python, along with proficiency in AWS services and tools such...

  • AI/ML Engineer

    2 months ago


    Pune, India ARR Recruitment Solutions Full time

    We are seeking a highly skilled Senior AI/ML Engineer with extensive experience in data integration, data processing, and building applications that handle large-scale data in the order of Terabytes from multiple sources. The ideal candidate will possess strong programming skills, particularly in Python, along with proficiency in AWS services and tools such...

  • AI/ML Engineer

    1 month ago


    Pune, Maharashtra, India ARR Recruitment Solutions Full time

    We are seeking a highly skilled Senior AI/ML Engineer with extensive experience in data integration, data processing, and building applications that handle large-scale data in the order of Terabytes from multiple sources. The ideal candidate will possess strong programming skills, particularly in Python, along with proficiency in AWS services and tools such...

  • Lead Data Architect

    6 hours ago


    Pune, India Mastercard Full time

    Lead Software Engineer - Python/Scala, Spark and hadoopExperience Needed- 12+ YearsOverviewAs a Lead Software Development Engineer in the Mastercard Data & Services Technologies team, you will play a valuable role within a successful and rapidly growing business unit, working closely with experienced and motivated engineers to solve challenging problems. As...