Senior Python Data Engineer

7 days ago

Delhi, Delhi, India AviinTech Business Solutions Full time

About the Role :

We are seeking an experienced Senior Python Data Engineer with a strong background in building scalable data pipelines, cloud-based data engineering solutions, and advanced reporting systems.

The ideal candidate will be proficient in Python-based development, AWS cloud services, and handling complex time-series data workflows.

This role is hands-on, requiring expertise in data ingestion, transformation, storage, and visualization to support business-critical analytics and reporting Responsibilities :

- Design, develop, and maintain data pipelines using Python and AWS services to process large-scale structured and unstructured datasets.

- Implement and optimize ETL processes for ingesting data from web APIs, IoT devices, and enterprise systems.

- Build scalable and fault-tolerant solutions leveraging AWS IoT SiteWise, Lambda, Glue, and EC2 for real-time and batch processing.

- Manage time-series datasets, ensuring efficient storage, retrieval, aggregation, and analysis for operational and analytical purposes.

- Develop and automate large-scale Excel and CSV-based reports, ensuring accuracy, performance, and usability.

- Integrate Grafana dashboards for real-time monitoring, visualization, and insights.

- Collaborate with data scientists, product managers, and business teams to deliver data-driven solutions aligned with organizational goals.

- Ensure best practices in data governance, quality, and security across all engineering Skills Required & Infrastructure (AWS):

- Strong expertise in AWS services: IoT SiteWise, Lambda (Python-based), Glue, EC2.

- Experience with AWS data integration and automation using Boto3 Development :

- Advanced Python coding skills with a focus on data engineering.

- Strong experience in time-series data handling and data transformation pipelines.

- Knowledge of PVLIB for solar data modeling and performance analysis (preferred, not mandatory).

- Proven experience in ETL pipelines and integrating with multiple web APIs.

- Hands-on experience in automated Excel report generation at & Reporting :

- Proficiency in Grafana for interactive dashboarding and visualization.

- Expertise in generating CSV & Excel reports, including scheduling and automation.

- Experience in building hourly/daily data aggregation frameworks for Qualifications :

- Strong problem-solving skills with an ability to work independently in a remote setting.

- Experience working in IoT-driven data ecosystems.

- Familiarity with data warehouse concepts and distributed data systems.

- Strong understanding of performance optimization and cost-effective AWS architecture

(ref:hirist.tech)

  • Senior Data Engineer

    7 days ago

    Delhi, Delhi, India Aptus Data Labs Full time

    Job Title : Senior Data EngineerLocation : : 58 YearsEmployment Type : Full-TimeAbout the Role :Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and...

  • Senior Python Software Engineer

    7 days ago

    Delhi, Delhi, India beBeeSoftware Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Python Software EngineerWe are seeking a highly skilled Senior Python software engineer to join our dynamic and innovative software development team. As a key member of the team, you will play a vital role in designing, developing, deploying, and maintaining robust and scalable RESTful APIs using FastAPI, Flask, or Django REST.Key...

  • Python Data Engineering Specialist

    7 days ago

    Delhi, Delhi, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 40,00,000

    Job Opportunity:">This position focuses on the development and implementation of data engineering solutions utilizing Python.">Key Responsibilities:">">Design, develop, and deploy Python-based data engineering solutions to meet business requirements.">Utilize API methods (GET, POST, PUT, DELETE) and RESTful APIs to facilitate efficient data exchange and...

  • Senior Data Engineer

    5 days ago

    Delhi, Delhi, India Collabera Full time

    Role : Senior Data EngineerArrangement : Fully Remote.Shift : US Time Zone (Night Shift).Industry : Financial Institution (FI) Credit Union.Job Summary : Collabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives.This role is...

  • Senior Data Engineer

    7 days ago

    Delhi, Delhi, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems.The ideal candidate will have a strong background in big data processing using Apache Spark, AWS, and cloud-based...

  • Senior Data Engineer

    3 days ago

    Delhi, Delhi, India Flodata Analytics Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title: Senior Data EngineerExperience: 2-3 yrsJob Type: Full-TimeShift Timing pm to 2.30-3am ISTAt Flodata Analytics, we are seeking a Senior Data Engineer to join our team. The ideal candidate will be a technical leader with a passion for transforming data into strategic business insights. This role requires a high degree of proficiency in SQL and...

  • Senior Data Engineer

    6 days ago

    Delhi, Delhi, India FloData Analytics Full time ₹ 6,00,000 - ₹ 7,00,000 per year

    Job Title: Senior Data EngineerJob Type: Full-time (Remote)Shift Timing pm to 2.30-3am ISTExperience Required: 2–3 YearsAt Flodata Analytics, we are seeking a Senior Data Engineer to join our team. The ideal candidate will be a technical leader with a passion for transforming data into strategic business insights. This role requires a high degree of...

  • Senior Data Engineer

    7 days ago

    Delhi, Delhi, India Vikash Technologies Full time

    Senior Data EngineerSenior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks. The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving Responsibilities : - Design and implement...

  • Senior Python Software Engineer

    6 days ago

    Delhi, Delhi, India Innefu Labs Full time US$ 1,50,000 - US$ 2,00,000 per year

    Company Description )We are a Series A Funded New Age Information Security & Data Analytics Company and we take pride in the fact that we have been delivering value to our customers with our innovative offerings and helping them adopt a variety of our security solutions that are based on cutting edge technologies like Artificial Intelligence, Predictive...

  • Senior Python Databricks Developer

    7 days ago

    Delhi, Delhi, India Volantis Technologies Full time

    Senior Python Databricks DeveloperLocation : Remote Type : Full-TimeAbout Volantis Technologies :At Volantis Technologies, we deliver cutting-edge digital and data solutions to help enterprises unlock the full potential of their data. We thrive on innovation, collaboration, and solving complex challenges across industries. Join us and be a part of a team...