Sr Bigdata developer

2 weeks ago


Gurugram, India Impetus Full time

Qualifications


  • 3.5-6 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive
  • Good hands-on experience of python and Bash Scripts
  • Good understanding of SQL and data warehouse concepts
  • Strong analytical, problem-solving, data analysis and research skills
  • Demonstrable ability to think outside of the box and not be dependent on readily available tools
  • Excellent communication, presentation and interpersonal skills are a must


Good to have:


  • Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. IAM, Glue, EMR, RedShift, S3, Kinesis)
  • Orchestration with Airflow and Any job scheduler experience
  • Experience in migrating workload from on-premises to cloud and cloud to cloud migrations


Roles & Responsibilities


  • Develop efficient ETL pipelines as per business requirements, following the development standards and best practices.
  • Perform integration testing of different created pipeline in AWS env.
  • Provide estimates for development, testing & deployments on different env.
  • Participate in code peer reviews to ensure our applications comply with best practices.
  • Create cost effective AWS pipeline with required AWS services i.e S3, IAM, Glue, EMR, Redshift etc.


Mandatory Skills

python, Pyspark, spark, big data


Locations - Pune, Bangalore, Indore, Noida and Gurugram


  • Sr Bigdata developer

    2 weeks ago


    Gurugram, India Impetus Full time

    Qualifications3.5-6 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and HiveGood hands-on experience of python and Bash ScriptsGood understanding of SQL and data warehouse conceptsStrong analytical, problem-solving, data analysis and research skillsDemonstrable ability to think outside of the box and...

  • Data Engineer

    1 month ago


    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    1 month ago


    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    1 month ago


    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    2 months ago


    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    1 month ago


    Gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong big query...

  • Data Engineer

    1 month ago


    gurugram, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong big query...


  • gurugram, India Impetus Full time

    Qualifications3.5-6 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and HiveGood hands-on experience of python and Bash ScriptsGood understanding of SQL and data warehouse conceptsStrong analytical, problem-solving, data analysis and research skillsDemonstrable ability to think outside of the box and...


  • gurugram, India Impetus Full time

    Qualifications 3.5-6 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive Good hands-on experience of python and Bash Scripts Good understanding of SQL and data warehouse concepts Strong analytical, problem-solving, data analysis and research skills Demonstrable ability to think outside of the...


  • gurugram, India Impetus Full time

    Qualifications 3.5-6 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive Good hands-on experience of python and Bash Scripts Good understanding of SQL and data warehouse concepts Strong analytical, problem-solving, data analysis and research skills Demonstrable ability to think outside of the...


  • Gurugram, India Hollister Incorporated Full time

    ummary: The Sr. Specialist Integrations Developer is responsible for design, development, testing, implementation, and documentation of required Integrations by JDS/Hollister Business functions. The Sr. Specialist Integrations Developer works with the Business Analysts, Application Owners and/or Business Relationship Operational Managers – Operational...


  • Gurugram, India Qlotech Full time

    Position: Sr. Business Development Manager OR Business Development ManagerLocations: Gurugram (Hybrid) Bangalore (WFH + In-field in Bangalore) Mumbai (WFH + In-field in Mumbai)Job Responsibilities: Responsible for sales of software products Develop excellent insights into the target market segments and geographies Create business proposals for new and...


  • Gurugram, India FyndBridge Consultants and Advisors Full time

    Overview:The Java/BigData Faculty plays a crucial role in equipping students with theknowledge and practical skills required for a successful career insoftware development and data analysis. They are responsible fordelivering highquality instruction and guidance to individualsaspiring to become proficient in Java programming and big...

  • Data Scientist Sr

    2 months ago


    Gurugram, India Insight Enterprises, Inc. Full time

    Requisition Number: 98013 Job Title: Sr Data Scientist Location: Delhi NCR, Hyderabad, Bangalore, Pune, Mumbai, Chennai, and Kolkata Now is the time to bring your expertise to a Sr Data Scientist role for a Fortune 500 Solutions Integrator where success and fulfillment go hand in hand. You will be at the forefront of helping businesses transform their...


  • Gurugram, Haryana, India Realign LLC Full time

    **Job Type: Full Time**: **Job Category: IT**: Job Title: Ab Initio Developer Job Summary: Responsibilities and Duties: 1. Design and implement data integration solutions using Ab Initio 2. Develop and maintain ETL processes 3. Work closely with business analysts and stakeholders to gather requirements 4. Troubleshoot and resolve technical issues 5....


  • Gurugram, India McCain Foods Full time

    ObjectiveWe're looking for a dynamic, talented and experienced Sr. Software Developer to join our growing team. You'll be responsible for developing and maintaining high-quality mobile apps on OutSystems Development Platform.QualificationsMaster / Bachelor’s degree in computer science, or a related software field.5 years of experience in mobile app...


  • Gurugram, India McCain Foods Full time

    ObjectiveWe're looking for a dynamic, talented and experienced Sr. Software Developer to join our growing team. You'll be responsible for developing and maintaining high-quality mobile apps on OutSystems Development Platform.QualificationsMaster / Bachelor’s degree in computer science, or a related software field.5 years of experience in mobile app...


  • Gurugram, India McCain Foods Full time

    Objective We're looking for a dynamic, talented and experienced Sr. Software Developer to join our growing team. You'll be responsible for developing and maintaining high-quality mobile apps on OutSystems Development Platform . Qualifications Master / Bachelor’s degree in computer science, or a related software field. 5 years of experience in mobile app...

  • Sr HR Executive

    4 weeks ago


    Gurugram, India HireBloc Ventures Pvt Ltd Full time

    Dear Applicants,We have an urgent opening for the Sr HR Executive and junior HR executive. Sr HR Executive ( 5nos )Experience 4yrs to 5yrsSalary up to 50K Junior HR Executive ( 5nos )Experience 1yrsSalary up to 30kJob Location - Sector 18 GGN Job Description:-Recognizing the manpower needs and taking them to the HR manager for approvalCreating job...


  • Gurugram, India AHEAD Full time

    AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises deliver on the promise of digital transformation.At AHEAD, we prioritize creating a culture of belonging, where all perspectives and voices are represented, valued, respected, and heard. We...