Python Data Engineer

2 weeks ago

Ahmedabad, Gujarat, India Albiorix Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Requirements

  • Strong proficiency in Python (pandas, PySpark, or similar frameworks).
  • Solid knowledge of SQL (query optimization, joins, indexing, performance tuning).
  • Experience with ETL frameworks/workflow orchestration (Airflow, or custom pipelines).
  • Hands-on with cloud platforms (AWS S3, Redshift, Glue, GCP BigQuery, Azure Data Factory).
  • Knowledge of data warehousing concepts and schema design (Star/Snowflake).
  • Familiarity with file formats such as JSON, Parquet, Avro.
  • Exposure to big data ecosystems (Hadoop, Spark, Hive, Kafka) is a plus.
  • Experience with containerization and orchestration (Docker, Kubernetes).
  • Familiarity with CI/CD practicesfor data pipelines (GitHub Actions, Jenkins, etc.).
  • Exposure to real-time/streaming platforms (Kafka, Kinesis, Pub/Sub).

Roles and Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL workflows using Python and SQL.
  • Work with structured, semi-structured, and unstructured data to ensure efficient ingestion, transformation, and storage.
  • Optimize data processes for performance, scalability, and cost-efficiency.
  • Manage and monitor data workflows to ensure accuracy, consistency, and reliability.
  • Implement data quality checks, validation, and error-handling mechanisms in pipelines.
  • Integrate data from multiple sources (databases, APIs, cloud storage, streaming platforms).
  • Work with cloud environments (AWS/Azure/GCP) for data storage, processing, and orchestration.
  • Maintain clear documentation of data workflows, schemas, and business logic.
  • Support and troubleshoot production issues in data pipelines and recommend improvements.

Nice to Have

  • Awareness of data security and governance (IAM roles, encryption).
  • Knowledge of monitoring/logging tools (CloudWatch, Grafana, ELK stack).
  • Awareness of data security and governance (IAM roles, encryption).

  • Python Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Albiorix Technology Pvt. Ltd. Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Experience: 3+ YearsJob Type: Full TimeLocation: AhmedabadRequirementsStrong proficiency in Python (pandas, PySpark, or similar frameworks).Solid knowledge of SQL (query optimization, joins, indexing, performance tuning).Experience with ETL frameworks/workflow orchestration (Airflow, or custom pipelines).Hands-on with cloud platforms (AWS S3, Redshift, Glue,...

  • Azure Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Phoenix It And Data Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Responsibilities: Design, develop, and maintain scalable data solutions using Azure Data Factory, Databricks, PySpark, Python, and SQL. Optimize pipelines, ensure data quality, and enable insights with Microsoft Fabric.

  • Python Automation Engineer

    1 week ago

    Ahmedabad, Gujarat, India MNC INTERNATIONAL TRADING LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Python Automation Engineer / Lead (6+ Yrs) | Selenium, Playwright, CI/CD | Hybrid About the OpportunityWe are seeking a highly experienced and technically strong Senior Python Automation Engineer / Lead to drive quality and innovation within our engineering team. This role is perfect for a self-starter with a passion for building robust, scalable...

  • Senior Data Engineer

    6 days ago

    Ahmedabad, Gujarat, India Augmented Ally IT Solutions Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Seeking a Senior Data Engineer skilled in ETL, Palantir Foundry, Python, PySpark, and AWS. Build scalable data solutions, ensure quality, and collaborate in Agile teams. 5+ years' experience required; utility domain is a plus. Required Candidate profileSenior Data Engineer expert in cloud, ETL, and big data tools. Strong in Python, PySpark, and AWS with...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India 44aea5e1-4ba1-4da3-a16a-676737e0cd33 Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Description:Designation -Data EngineerLocation - AhmedabadJob Description:We are looking for a Data Engineer to join our growing team of analytics experts. The hire will beresponsible for expanding and optimizing our data and data pipeline architecture, as well asoptimizing data flow and collection for cross functional teams. The ideal candidate is an...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India ProductSquads Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    About the CompanyCompany Profile: ProductSquads was founded with a bold mission: to engineer capital efficiency through autonomous AI agents, exceptional engineering, and real-time decision intelligence. We're building an AI-native platform that redefines how software teams deliver value—whether through code written by humans, agents, or both. Our stack...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India 152e5fd2-a4a9-4f58-a6b5-7254669ac8a3 Full time ₹ 10,00,000 - ₹ 15,00,000 per year

    Job Title: Data EngineerExperience: 5+ YearsLocation: AhmedabadEmployment Type: Full-timeJob Description: We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and ETL workflows. The ideal candidate should have strong experience with big data technologies, cloud platforms, and data modeling.Key...

  • Data Engineer

    2 days ago

    Ahmedabad, Gujarat, India Career Break Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Calling All Data Engineering RockstarsJob Title: Data EngineerLocation: Ahmedabad, GujaratShift: UK Day Shift (Monday – Friday)Timings: 12:30 PM – 9:30 PM | 1:30 PM – 10:30 PMWhy This Role RocksAre you passionate about building data pipelines that actually power decisions? Do you geek out over clean, scalable architectures and love turning messy data...

  • Python Developer

    2 weeks ago

    Ahmedabad, Gujarat, India Zigsaw Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    ResponsibilitesWork experience as a Python DeveloperCompetence to write clear, optimized, necessary codeStrong problem solving and project management skillsCapability to solve complex technical issues, comprehend risks prior to the circumstanceCollaboration and team-orientationask organization, time management, and project managementCreativity, originality,...

  • Sr. Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Hitech Digital Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Position SummaryWe are seeking a Data Engineer / Lead Data Engineer with deep experience in data architecture, ETL pipelines, and advanced analytics support. This role is crucial for designing robust pipelines to process structured and unstructured data, integrate ML models, and ensure data reliability. The ideal candidate will be proficient in Python, R,...