SENIOR DATA ENGINEER with PYTHON

17 hours ago

Noida, Uttar Pradesh, India Soft Elevation Full time ₹ 30,00,000 - ₹ 40,00,000 per year

Company Overview

Soft Elevation has fronted our client's goals by transforming their ideas into functional products. From IoT and Blockchain, to IoT and Big Data, to Custom Web Development, to Bespoke Mobile App Development, to UI/UX design there is no technology we have left in the raw. Our team of specialist Tech experts can remold from scratch a raw idea into a functional and seamless solution that packs a punch and generate value for 100+ service and product-based enterprises and startups. We are a global player in the world of software and development solutions, working with the new-fangled, futuristic technologies and app development, with an experience of serving a global base of clients not limited to US, Europe, Asian markets, and not to say the oceanic from Australia, and New Zealand. We enable SMBs to be the market trailblazers by delivering leading-edge custom software on a competitive budget overlay. We have made up a name for being an experienced software development company with a nimbleness to deliver top-notch service from the early conception stage to a fully functioning product, including ongoing tech support, as a single solution.

Our software is designed to automate the dispatching process, allowing transportation providers to manage schedules, assign drivers, and track vehicles in real-time. With our customizable billing and reporting features, users can easily manage their finances and gain valuable insights into their operations.

What you'll be doing:

  • Design, build, and maintain scalable data pipelines and backend frameworks for high-volume data ingestion.

  • Develop robust ETL processes to integrate data from diverse sources (APIs, relational databases, file systems).

  • Optimize data workflows for performance, scalability, and reliability.

  • Collaborate with backend and AI/ML teams to integrate data-driven features into production systems.

  • Implement data validation, quality checks, and monitoring across pipelines.

  • Contribute to architecture discussions and drive best practices in data engineering.

  • Stay current with emerging technologies in Python, data engineering, and AI integration.

Tech we're using:

  • Python (FastAPI, Pandas, NumPy, Pydantic)

  • Distributed systems and frameworks: Spark, Dask, Airflow

  • Data tools: Databricks, Delta Lake, dbt

  • Databases: SQL & NoSQL systems, query optimization, and data modeling

  • Cloud platforms: Azure (preferred), AWS, GCP

  • Streaming & caching: Redis, Kafka

  • CI/CD, containerization, and orchestration tools (Docker, Kubernetes)

  • Version control & collaboration: Git, Jira, Confluence

What we're looking for:

  • 5+ years of backend or data engineering experience with strong Python expertise.

  • Proven experience in building and managing data pipelines and ETL processes.

  • Hands-on experience with large-scale datasets and distributed data systems.

  • Familiarity with AI integration, ML pipelines, and cloud-based environments.

  • Strong problem-solving, communication, and collaboration skills with a focus on clean, high-quality code.

Job Types: Full-time, Permanent

Pay: ₹3,000, ₹4,000,000.00 per year

Work Location: In person

  • Senior Python Data Engineer — Azure Databricks

    6 days ago

    Noida, Uttar Pradesh, India Algoworks Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    About the roleWe're looking for a Senior Python Data Engineer (4+ years) with deep hands-on experience in Azure Databricks, PySpark, Spark SQL, and Power BI. You'll design, build, and optimize reliable data platforms and analytics solutions—partnering with product, analytics, and business teams in a fast-paced, collaborative environment.What you'll do•...

  • Python developer

    1 week ago

    Noida, Uttar Pradesh, India Gauge data solutions Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Essential SkillsDevelop, enhance and maintain Python related projects, data services, platforms and processes.Apply and maintain data quality checks to ensure data integrity and completeness.Able to integrate multiple data sources and databases.Collaborate with cross-functional teams across, Decision Sciences, Search, Database Management. To design...

  • Python Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India ShyftLabs Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    POSITION OVERVIEW We are seeking a highly skilled Python Data Engineer with a strong background in designing, developing, and maintaining scalable data solutions. The ideal candidate will have 5+ years of professional experience in Python and SQL, with proven expertise in building ETL/ELT pipelines, managing data streaming solutions. This role requires a...

  • Python Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Coforge Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Generative AI Python Senior Specialist EngineerBand: 3 & 4.xLocation –Greater NoidaJob Summary:Coforge is looking for a Generative AI Python Senior Specialist Engineer to build both Traditional AI/ML as well as Generative AI based systems. The candidate should be highly skilled in programming & statistics with the ability to confidently assess,...

  • Data Engineer-AWS, Python

    7 days ago

    Noida, Uttar Pradesh, India 3Pillar Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial...

  • Senior Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India Tekskills Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Data Engineer – Azure & DatabricksLocation:Noida (WFO)Skills Required: Digital : Microsoft AzureExperience Range Required: 8 to 10 Years(Rel 7+ yrs)Job Description:Must-HaveLead Back-end development maintenance of Data Quality ProductDesign and develop Data Pipeline using ADF, Databricks and integrate with other Azure ServicesExperience...

  • Data Engineer-AWS, Python

    1 week ago

    Noida, Uttar Pradesh, India 3Pillar Global Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial...

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Vserv Careers Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Profile - Senior Data EngineerExp- 4+ YearsLocation - NoidaWork Mode - HybridSkills - Data Engineering , Team Lead , Snowflake , AWS/Azure , Databricks , DBT , Data Warehousingfor applying you can share your CV on Key ResponsibilitiesDevelop and execute data strategy, focusing on public healthcare datasets such as Medicare, Medicaid, and other federal and...

  • Senior Data Engineer

    2 days ago

    Noida, Uttar Pradesh, India 3Pillar Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial...

  • Lead Python Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India Algoworks Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Lead Python Data Engineer - Databricks (Unity Catalog, Delta, CI/CD) Job SummaryWe are seeking a highly skilled Data Engineer with a strong background in Databricks and a passion for data engineering. The ideal candidate will have extensive experience in designing and implementing data solutions using various technologies, including PySpark, Spark SQL, and...