Lead Data Engineer- Python

4 days ago

Noida, Uttar Pradesh, India Infinium Associates Full time ₹ 40,00,000 - ₹ 48,00,000 per year

About the Role:

We are seeking a talented Lead Data Engineer to join our team and play a pivotal role in transforming raw data into valuable insights. As a Data Engineer, you will design, develop, and maintain robust data pipelines and infrastructure to support our organization's analytics and decision-making processes.

Responsibilities:

  • Data Pipeline Development: Build and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources (e.g., databases, APIs, files) into data warehouses or data lakes.
  • Data Infrastructure: Design, implement, and manage data infrastructure components, including data warehouses, data lakes, and data marts.
  • Data Quality: Ensure data quality by implementing data validation, cleansing, and standardization processes.
  • Team Management: Able to handle team.
  • Performance Optimization: Optimize data pipelines and infrastructure for performance and efficiency.
  • Collaboration: Collaborate with data analysts, scientists, and business stakeholders to understand their data needs and translate them into technical requirements.
  • Tool and Technology Selection: Evaluate and select appropriate data engineering tools and technologies (e.g., SQL, Python, Spark, Hadoop, cloud platforms).
  • Documentation: Create and maintain clear and comprehensive documentation for data pipelines, infrastructure, and processes.

Skills:

  • Strong proficiency in SQL and at least one programming language (e.g., Python, Java).
  • Experience with data warehousing and data lake technologies (e.g., Snowflake, AWS Redshift, Databricks).
  • Knowledge of cloud platforms (e.g., AWS, GCP, Azure) and cloud-based data services.
  • Understanding of data modeling and data architecture concepts.
  • Experience with ETL/ELT tools and frameworks.
  • Excellent problem-solving and analytical skills.
  • Ability to work independently and as part of a team.

Preferred Qualifications:

  • Experience with real-time data processing and streaming technologies (e.g., Kafka, Flink).
  • Knowledge of machine learning and artificial intelligence concepts.
  • Experience with data visualization tools (e.g., Tableau, Power BI).
  • Certification in cloud platforms or data engineering.

Job Types: Full-time, Permanent

Pay: ₹4,000, ₹4,800,000.00 per year

Ability to commute/relocate:

  • Noida, Uttar Pradesh: Reliably commute or planning to relocate before starting work (Required)

Experience:

  • Python: 5 years (Required)
  • Data Engineer: 5 years (Required)

Work Location: In person

  • Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 303115NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties As a data engineer you will have a...

  • Python Lead

    1 week ago

    Noida, Uttar Pradesh, India Masthead Technologies Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking a Python Lead Developer with a proven track record in building robust, scalable applications and leading high-performing development teams. This role requires strong expertise in Python programming, web scraping, and application development, with a focus on delivering efficient, high-quality solutions.Key ResponsibilitiesLeadership and Team...

  • Python Lead Engineer

    1 week ago

    Noida, Uttar Pradesh, India TalentOnLease Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Primary Skillset:Python, Flask, FastAPI, NodeJS and ReactUI (Nice to have), OpenSearch/Mongo vector DB, AWS Cloud Services, AWS BedRock, Azure OpenAI and Google Vertex AISecondary Skillset:Jenkins, Agile Sprint and Kanban board, JIRA, Terraform/Terragrunt (optional), Confluence Documentations, Code Covereage, Snyk and security...

  • Python Lead Engineer

    1 week ago

    Noida, Uttar Pradesh, India TalentOnLease Pvt Ltd. Full time

    Primary Skillset :- Python, Flask, FastAPI, NodeJS and ReactUI (Nice to have), OpenSearch/Mongo vector DB, AWS Cloud Services, AWS BedRock, Azure OpenAI and Google Vertex Skillset : - Jenkins, Agile Sprint and Kanban board, JIRA, Terraform/Terragrunt (optional), Confluence Documentations, Code Covereage, Snyk and security : - Collaborate with machine...

  • Software Engineer, Python

    1 week ago

    Noida, Uttar Pradesh, India Pretlist Full time

    Job DescriptionIf you are an Engineer with background in Python, then join our growing team. This is an exciting opportunity to work with cutting-edge pivot control technology You&aposll be at the forefront of innovation, contributing to a truly unique project. You dream it; you build it. Lets build something big together.Responsibilities- Demonstrate strong...

  • Mid Data Science

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 312499 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Mid Data Science AIML GenAI Lead Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job...

  • Python Developer Lead

    7 days ago

    Noida, Uttar Pradesh, India Innovationm Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Project OverviewPrestigious Client / Project: Work with trusted global partner delivering end-to-end digital, engineering, and manufacturing solutions to top-tier clients across automotive, healthcare, and industrial sectorsRevolutionizing Technologies: Build or enhance Python-based enterprise appsranging from IoT data pipelines and RPA bots to backend APIs...

  • Python - Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India IRIS software Full time

    Job DescriptionWhy Join UsAre you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industryDo you want to do the best work of your life at one of thefastest growing IT services companies Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations It'shappening right hereat Iris...

  • Urgent Opening For Technical Lead- Python

    1 week ago

    Noida, Uttar Pradesh, India Vinove Software Full time US$ 1,25,000 - US$ 1,75,000 per year

    Please find the JD attached for Technical Lead - PythonThe job description of a Technical Lead specializing in Python typically includes a variety of responsibilities and qualifications tailored to leveraging Python's capabilities in software development and engineering. Here's a detailed outline of what such a role might entail:Job Description:1. Technical...

  • Python Engineer

    1 week ago

    Noida, Uttar Pradesh, India Vikash Technologies Full time

    Responsibilities :- Over 6 years of extensive hands-on experience in Python and distributed computing concepts.- Exp in NLP- Over 5 years of experience in Kafka or similar streaming technologies.- Over 5 years of experience in Spark (Pyspark preferred).- Experienced in working with cloud native technologies, such as, Kubernetes.- Good understanding of devops...