Data Engineer

1 month ago


delhi, India SourceBae Full time
Job Title: Data Engineer
Exp-5+ years experience
Responsibilities:
Design, develop, and maintain scalable and efficient data pipelines and ETL processes using Python and PySpark.
Build and optimize data pipelines for large-scale data processing and analytics.
Implement data processing algorithms and data transformations for cleansing, aggregation, and analysis.
Collaborate with data scientists and analysts to understand data requirements and provide data engineering support.
Develop and maintain data warehouse solutions for storing and querying large volumes of structured and unstructured data.
Monitor and optimize the performance of data pipelines and processing jobs.
Troubleshoot and debug issues with data pipelines and data quality.
Ensure data security, privacy, and compliance with regulatory requirements.
Document data pipelines, processes, and infrastructure components.
Stay up-to-date with the latest technologies and trends in data engineering and big data processing.
Requirements:
5+ years of experience working as a Data Engineer or similar role.
Strong programming skills in Python.
Hands-on experience with Apache Spark and PySpark.
Proficiency in SQL and experience with database technologies (e.g., PostgreSQL, MySQL, or similar).
Experience designing and building scalable data pipelines and ETL processes.
Knowledge of distributed computing concepts and frameworks.
Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
Familiarity with containerization and orchestration tools like Docker and Kubernetes.
Experience with data warehousing solutions (e.g., Amazon Redshift, Google BigQuery, or similar).
Strong problem-solving and analytical skills.
Excellent communication and collaboration skills.
Bachelor's degree in Computer Science, Engineering, or a related field.
Nice to have:
Experience with streaming data processing frameworks (e.g., Apache Kafka, Apache Flink).
Knowledge of machine learning and data science concepts.
Experience with DevOps practices and tools.
Certification in relevant technologies (e.g., AWS Certified Big Data - Specialty, Databricks Certified Associate Developer for Apache Spark).
  • Operations Specialist

    2 weeks ago


    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    2 weeks ago


    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • QA Engineer

    3 weeks ago


    delhi, India Data Unveil Full time

    Position Title: QA EngineerLevel: Mid-LevelLocation: Hyderabad, Telangana.Hire Type: Full TimeStart Date: ImmediateMinimum 3+ years of QA experience in data projects.Collaborate with the Development/Business teams to understand the requirements.Analyzing Business Requirements/cases and developing/managing the positive/negative test scenarios cases.Ability to...

  • Data Engineer

    4 weeks ago


    delhi, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...


  • New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...


  • New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • Data Engineer

    2 months ago


    Delhi, India ValueLabs Full time

    Experience -6+YearsPrimary Skills -ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLakeSecondary Skills -PowerBl, Data modelingNotice Period - Immediate - 15 daysJob Description:The Data Engineer is responsible for designing, developing, and maintaining data pipelines and data warehouses to support the...

  • Data Engineer

    3 weeks ago


    Delhi, India Straive Full time

    Job Role- AWS Data Engineer Experience- 4 to 6 years Mode- Remote The Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabilities that unleash the value of the data assets to gain competitive advantage in...

  • Data Engineer

    2 months ago


    delhi, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    2 weeks ago


    delhi, India Evive | goevive.com Full time

    We’re looking for a thorough Data Engineer. Is it you?The Data Engineer designs and builds the data pipelines that will enable faster and more accurate data-informed recommendations and decisions both inside and outside of the Evive platform. On a daily basis they design and build services to collect, compile, normalize, and analyze data assets coming from...


  • delhi, India Liberty Data Analytics Full time

    Senior Specialist, Data SolutionsProvides, builds, and maintains data solutions to meet the needs of the enterprise. Helps ensure those solutions can be scaled appropriately. Under minimal to no direction, works within broad limits and authority on highly complex assignments requiring specialized knowledge. Viewed as senior resource in given field for...

  • Data Engineer

    2 months ago


    delhi, India ValueLabs Full time

    Experience - 6+YearsPrimary Skills - ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLakeSecondary Skills - PowerBl, Data modelingNotice Period - Immediate - 15 daysJob Description: The Data Engineer is responsible for designing, developing, and maintaining data pipelines and data warehouses to support the...

  • Data Engineer

    2 months ago


    Delhi, India Straive Full time

    Job Role- AWS Data EngineerExperience- 4 to 6 yearsMode- RemoteThe Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabilities that unleash the value of the data assets to gain competitive advantage in the...

  • Data Engineer

    3 days ago


    delhi, India Birlasoft Full time

    About the Job - Data Engineer with Azure, Hive and HadoopJob Title – Data EngineerLocation - Pune, Bangalore, Mumbai, Chennai, Hyderabad, NoidaEducational Background - UG -B.Tech /B.E in any specialization & PG. MCA/MSC in Computers.Key Responsibilities -Experience in implementing and managing data pipelines using modern orchestration tools like...

  • Data Engineer

    1 month ago


    Delhi, India Infomatics Corp Full time

    Position Overview: We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure and systems. You will collaborate closely with cross-functional teams to ensure the reliability, scalability, and efficiency of our data...

  • Data Engineer

    3 weeks ago


    Delhi, India Infomatics Corp Full time

    Position Overview: We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure and systems. You will collaborate closely with cross-functional teams to ensure the reliability, scalability, and efficiency of our data...

  • Data Engineer

    2 weeks ago


    delhi, India WaferWire Cloud Technologies Full time

    Role: Data EngineerExperience: 3–6 YearsLocation: HyderabadJob DescriptionWe are seeking a seasoned Data Engineer to join our team in Hyderabad. The ideal candidate will have a strong background in data engineering, with extensive experience in SQL, data pipelines, Azure Synapses Data Warehouses, and data modeling.Key Responsibilities:Design, develop,...

  • Data Engineer

    4 days ago


    delhi, India Akkodis Full time

    Position: Data EngineerWe are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in our data infrastructure, leveraging your expertise in SQL, Teradata, GitLab, ETL processes, SSIS integration, data transformation, and data structures.Responsibilities:- Design, develop, and maintain efficient data...