Data Engineer

3 weeks ago

Solapur, Maharashtra, India CareerXperts Consulting Full time

We are seeking a skilled Data Engineer to design, build, and optimize scalable data infrastructure that powers analytics, reporting, and machine learning. You will work closely with data scientists, analysts, and engineers to ensure data is accurate, reliable, and accessible across the organization.

Key Responsibilities

  • Design, build, and maintain data pipelines for batch and real-time processing.
  • Develop and optimize ETL/ELT workflows to ingest, transform, and load data.
  • Ensure data quality, reliability, and governance across systems.
  • Work with cloud platforms (AWS/GCP/Azure) to manage storage, compute, and streaming solutions.
  • Implement best practices for data modeling, warehousing, and schema design.
  • Collaborate with cross-functional teams to understand data needs and deliver scalable solutions.
  • Monitor, troubleshoot, and optimize data pipelines and workflows.
  • Maintain documentation for data processes and architecture.

Required Skills & Qualifications

  • Bachelor's/Master's degree in Computer Science, Data Engineering, or related field.
  • Strong proficiency in SQL and data modeling.
  • Hands-on experience with ETL tools (Airflow, dbt, Informatica, Talend, etc.).
  • Experience with big data frameworks (Apache Spark, Hadoop, Kafka, Flink).
  • Strong programming skills in Python/Scala/Java.
  • Familiarity with data warehousing solutions (Snowflake, Redshift, BigQuery, Synapse).
  • Experience working with cloud data platforms (AWS Glue, GCP Dataflow, Azure Data Factory).
  • Understanding of data governance, security, and compliance.

Nice-to-Have Skills

  • Experience with real-time streaming pipelines (Kafka, Kinesis, Pulsar).
  • Exposure to containerization & orchestration (Docker, Kubernetes).
  • Knowledge of machine learning pipelines (MLOps).
  • Familiarity with DevOps tools for CI/CD in data engineering.

  • Data Analyst

    1 week ago

    Solapur, Maharashtra, India Quant-data Full time

    We're Hiring: Data Analyst (Credit Analytics | Remote | Full-Time) Leverage financial and credit data to power AI-driven lending solutionsWe are seeking a skilled Data Analyst (Credit Analytics) with 4+ years of experience to join our AI-driven lending platform team. In this role, you will analyze financial, customer, and transaction datasets, generate...

  • Automation Framework Specialist

    6 days ago

    Solapur, Maharashtra, India beBeeTest Engineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Automation Tester">">About this Role:We are seeking an experienced Automation Tester to lead our testing efforts. In this role, you will be responsible for designing and implementing automated testing frameworks using Python.Key Responsibilities:">Design and develop automated testing frameworks using Python.">Implement test automation scripts using tools...

  • Data Engineer

    1 week ago

    Solapur, Maharashtra, India Insight Global Full time

    Analytic Engineer Location : 100% REMOTE (must work in EST Zone) Duration: 6-month contract to hire Pay Rate : $ - USD (Dependent upon experience/ Conversion salary: Up to 35K Tentative Start Date: ASAP (Immediate joiners or 40 day or less notice period)- cannot have another job while working for this client. **This role will be 100% remote, candidate...

  • Mastering Data Engineering

    1 day ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering Professional">We are seeking a skilled Data Engineering professional to join our team. The ideal candidate will have experience in digital channel activities, data engineering, and cloud technologies.This role involves working on a project that focuses on integrating and processing channel activity data from multiple sources,...

  • Data Engineer Opportunity

    23 hours ago

    Solapur, Maharashtra, India beBeedataengineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering OpportunityWe are seeking an experienced Data Engineer to design and develop scalable data pipelines.

  • Senior Data Engineer

    6 days ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerAbout the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to drive the technical depth, accuracy, and instructional value of our training content.This role is responsible for defining and validating learning content aligned to industry-recognized certification paths, providing technical guidance on data...

  • GCP Data Engineer

    2 weeks ago

    Solapur, Maharashtra, India Tata Consultancy Services Full time

    TCS present an excellent opportunity for GCP Data EngineerJob Location: Bangalore, Chennai , Hyderabad, PuneExperience required : 10 yrsSkills: GCP Data Engineer , Bigquery , PythonRequirements:- Proficiency in programming languages: Python, Java- Expertise in data processing frameworks: Apache Beam (Data Flow)- Active experience on GCP tools and...

  • Data Engineering Specialist

    6 days ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 10,80,000 - ₹ 14,40,000

    Job Title: Data Engineering SpecialistDescription:Azure data engineers play a vital role in crafting and maintaining large-scale data processing systems. To excel in this position, one must have a strong foundation in data engineering principles, cloud-based technology experience, and exceptional problem-solving skills.Key Responsibilities:Design and develop...

  • GCP Data Engineer

    3 weeks ago

    Solapur, Maharashtra, India RapidBrains Full time

    GCP Data Engineer Experience - 4+ Years Location - Remote Contract Duration - Long Term Work Time - 2:00 PM to 11:00 PMJob Description We are seeking a skilled GCP Data Engineer to design, build, and optimize scalable data pipelines and cloud-based solutions on Google Cloud Platform. The ideal candidate will have strong expertise in data engineering best...

  • Data Engineering Opportunities

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Unlock Your Data Engineering PotentialWe are seeking a skilled Data Engineer to join our high-impact team. This exciting role offers the opportunity to build, scale, and innovate in the field of data engineering.The ideal candidate will have hands-on experience with:Databricks, SQL, PySpark, and PythonStrong knowledge of Spark, Delta Lake, and Data Lakehouse...