Senior Python Data Engineer

4 weeks ago

Delhi, Delhi, India AviinTech Business Solutions Full time

About the Role :

We are seeking an experienced Senior Python Data Engineer with a strong background in building scalable data pipelines, cloud-based data engineering solutions, and advanced reporting systems.

The ideal candidate will be proficient in Python-based development, AWS cloud services, and handling complex time-series data workflows.

This role is hands-on, requiring expertise in data ingestion, transformation, storage, and visualization to support business-critical analytics and reporting Responsibilities :

- Design, develop, and maintain data pipelines using Python and AWS services to process large-scale structured and unstructured datasets.

- Implement and optimize ETL processes for ingesting data from web APIs, IoT devices, and enterprise systems.

- Build scalable and fault-tolerant solutions leveraging AWS IoT SiteWise, Lambda, Glue, and EC2 for real-time and batch processing.

- Manage time-series datasets, ensuring efficient storage, retrieval, aggregation, and analysis for operational and analytical purposes.

- Develop and automate large-scale Excel and CSV-based reports, ensuring accuracy, performance, and usability.

- Integrate Grafana dashboards for real-time monitoring, visualization, and insights.

- Collaborate with data scientists, product managers, and business teams to deliver data-driven solutions aligned with organizational goals.

- Ensure best practices in data governance, quality, and security across all engineering Skills Required & Infrastructure (AWS):

- Strong expertise in AWS services: IoT SiteWise, Lambda (Python-based), Glue, EC2.

- Experience with AWS data integration and automation using Boto3 Development :

- Advanced Python coding skills with a focus on data engineering.

- Strong experience in time-series data handling and data transformation pipelines.

- Knowledge of PVLIB for solar data modeling and performance analysis (preferred, not mandatory).

- Proven experience in ETL pipelines and integrating with multiple web APIs.

- Hands-on experience in automated Excel report generation at & Reporting :

- Proficiency in Grafana for interactive dashboarding and visualization.

- Expertise in generating CSV & Excel reports, including scheduling and automation.

- Experience in building hourly/daily data aggregation frameworks for Qualifications :

- Strong problem-solving skills with an ability to work independently in a remote setting.

- Experience working in IoT-driven data ecosystems.

- Familiarity with data warehouse concepts and distributed data systems.

- Strong understanding of performance optimization and cost-effective AWS architecture

(ref:hirist.tech)

  • Senior Data Engineer

    4 weeks ago

    Delhi, Delhi, India Aptus Data Labs Full time

    Job Title : Senior Data EngineerLocation : : 58 YearsEmployment Type : Full-TimeAbout the Role :Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and...

  • Senior Data Engineer

    4 weeks ago

    Delhi, Delhi, India Collabera Full time

    Role : Senior Data EngineerArrangement : Fully Remote.Shift : US Time Zone (Night Shift).Industry : Financial Institution (FI) Credit Union.Job Summary : Collabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives.This role is...

  • Senior Data Engineer

    2 days ago

    Delhi, Delhi, India Flodata Analytics Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title: Senior Data EngineerExperience: 2-3 yrsJob Type: Full-TimeShift Timing pm to 2.30-3am ISTAt Flodata Analytics, we are seeking a Senior Data Engineer to join our team. The ideal candidate will be a technical leader with a passion for transforming data into strategic business insights. This role requires a high degree of proficiency in SQL and...

  • Senior Data Engineer

    6 days ago

    Delhi, Delhi, India FloData Analytics Full time ₹ 6,00,000 - ₹ 7,00,000 per year

    Job Title: Senior Data EngineerJob Type: Full-time (Remote)Shift Timing pm to 2.30-3am ISTExperience Required: 2–3 YearsAt Flodata Analytics, we are seeking a Senior Data Engineer to join our team. The ideal candidate will be a technical leader with a passion for transforming data into strategic business insights. This role requires a high degree of...

  • Senior Data Engineer

    4 weeks ago

    Delhi, Delhi, India Vikash Technologies Full time

    Senior Data EngineerSenior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks. The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving Responsibilities : - Design and implement...

  • Senior Data Engineer

    4 weeks ago

    Delhi, Delhi, India YO IT CONSULTING Full time

    Job DescriptionTitle : Senior Data EngineerExperience : 2 to 3 years Fully remote Shift Timing : 5.30-6pm to 2.30-3am ISTMust Haves : - Python- Tableau- SQLRole And Responsibilities : Key Responsibilities : - Lead Business Intelligence & Analytics : a. Design, develop, and maintain advanced Tableau dashboards and reports that provide actionable insights to...

  • Senior Python Databricks Developer

    4 weeks ago

    Delhi, Delhi, India Volantis Technologies Full time

    Senior Python Databricks DeveloperLocation : Remote Type : Full-TimeAbout Volantis Technologies :At Volantis Technologies, we deliver cutting-edge digital and data solutions to help enterprises unlock the full potential of their data. We thrive on innovation, collaboration, and solving complex challenges across industries. Join us and be a part of a team...

  • Findify - Senior Backend Engineer - Python Programming

    3 weeks ago

    Delhi, Delhi, India Findify Consultants Full time

    Role : Senior Python Backend EngineerLocation : RemoteExperience : 5+ YearsEmployment Type : Full-timeJob Overview : We're searching for a high-caliber Senior Python Backend Engineer with deep proficiency in Python and a proven track record of building large-scale, high-performance systems. As a core member of our backend team, you'll be instrumental in...

  • Senior Data Engineer

    4 weeks ago

    Delhi, Delhi, India One Click AI Full time

    Job Title : Senior Data Engineer (Snowflake)Location : Onsite Pune/DelhiEmployment Type : Full-Time (Payroll)Experience : 5-6 YearsCompensation : 15-25 LPADuration : the Role :Agivant is seeking a highly skilled and passionate Senior Data Engineer to join our growing data team. In this role, you will be responsible for designing, building, and scaling...

  • Senior Data Engineer with MLOps

    1 week ago

    Delhi, Delhi, India Strive4X Infotech Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    As a Senior Data Engineer at our company, you will be responsible for designing and implementing scalable data pipelines, productionizing ML workflows, and ensuring system observability. This is a hands-on role that requires expertise in Databricks, Spark, AWS, and MLOps. Your coding skills and execution focus will be crucial in contributing from day one....