Senior Data Engineer

7 days ago

Ghaziabad, Uttar Pradesh, India Impetus Full time

Open Location - Indore, Noida, Gurgaon, Bangalore, Hyderabad, Pune

Immediate Joiners are preferred.

Qualification

  • 4 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive
  • Good hands-on experience of python and Bash Scripts
  • Good understanding of SQL and data warehouse concepts
  • Strong analytical, problem-solving, data analysis and research skills
  • Demonstrable ability to think outside of the box and not be dependent on readily available tools
  • Excellent communication, presentation and interpersonal skills are a must
  • Hands-on experience with using Cloud Platform provided Big Data technologies
  • Orchestration with Airflow and Any job scheduler experience
  • Experience in migrating workload from on-premises to cloud and cloud to cloud migrations

Roles & Responsibilities

  • Develop efficient ETL pipelines as per business requirements, following the development standards and best practices.
  • Perform integration testing of different created pipeline in Cloud env.
  • Provide estimates for development, testing & deployments on different env.
  • Participate in code peer reviews to ensure our applications comply with best practices.
  • Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.
  • Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
  • Writes unit/integration tests, contributes to engineering wiki, and documents work.
  • Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
  • Works closely with a team of frontend and backend engineers, product managers, and analysts.
  • Defines company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models.
  • Designs data integrations and data quality framework.

Mandatory Skills - Any Cloud, Python Programming, SQL, Pyspark

  • Senior Data Engineer Role

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000

    Job Title:Senior Data Engineer RoleA senior data engineer is required to build data pipelines and integrate healthcare data with expertise.

  • Senior Data Engineer

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join our team. As a key member of our data engineering group, you will design, develop, and maintain large-scale data pipelines and ETL processes on Databricks.The ideal candidate will have 7+ years of experience in Data Engineering and a proven track record of delivering...

  • Senior Data Engineer

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 6,00,000 - ₹ 10,00,000

    Job Title: Senior Data EngineerThis role is an excellent opportunity to leverage your expertise in data engineering and take on a challenging project with our team. As a senior data engineer, you will design, develop, and optimize large-scale data processing solutions using PySpark, Python, SQL, and real-time data streaming.Our ideal candidate will have...

  • Senior Data Engineering Specialist

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 30,00,000

    Job Title: Senior Data Engineering SpecialistAbout the RoleWe are seeking an experienced data engineering specialist to join our team. As a key member, you will be responsible for designing and developing end-to-end data integration solutions, optimizing workflows, and collaborating with business and technical stakeholders to deliver scalable and...

  • Senior Data Engineer

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Senior Data Engineer - Contract OpportunityOverview:The role of Senior Data Engineer- Contract is an exciting opportunity for a skilled professional to join our organization and contribute to the development of innovative data solutions.Key Responsibilities:Design, develop, and implement advanced data models using star schema, facts & dimensions...

  • Senior Data Engineering Professional

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Title: Senior Data Engineering ProfessionalWe are seeking a highly skilled professional with 4+ years of experience in Azure Data Engineering, holding strong expertise in Python, Scala, Spark (PySpark & Scala Spark), and Azure Cloud technologies. The ideal candidate will have hands-on experience designing, building, and optimizing ETL pipelines, working...

  • Unlock Career Potential as a Senior Data Engineer

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataengineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to play a critical role in the integration, development, and support of our newly implemented Fabric Data & Analytics Platform.Main Responsibilities:Designing, developing, and maintaining ETL pipelines to extract, transform, and load data into various...

  • Senior Data Engineering Professional

    6 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Overview:We are seeking a highly skilled and detail-oriented Senior Data Engineer to design, develop, and execute automated and manual test cases for data validation and transformation processes.About the Role:The ideal candidate will have strong experience in Python, Pandas, REST API, and testing with a solid understanding of data validation, data...

  • Senior Data Engineer Opportunity

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 19,00,000

    Job DescriptionWe are seeking a senior data engineer to join our team.Design, develop, and maintain large-scale data processing systems.Key Responsibilities:Develop efficient data pipelines using Python.Implement data warehousing and business intelligence solutions using Snowflake.Required Skills and QualificationsEssential Skills:Proficiency in Python...

  • Highly Skilled Data Engineering Expert

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a highly skilled data engineer to join our team. As a senior data engineer, you will be responsible for providing technical direction and setting high standards for code quality in data-intensive environments.The ideal candidate will have prior experience as a principal engineer, leading teams and mentoring members, with a...