Data Engineer

4 weeks ago


Anywhere in IndiaMultiple Locations Coders Brain Technology & Private Limited Full time

About the role :

- As a Data Engineer Specialist, you will be a subject matter expert responsible for developing and maintaining data pipelines to assist us aggregate number of client data sources into a single view for our teams to utilize. The data is often incomplete, inconsistent and stored in silos with access primarily through APIs and FTPs. We are looking for a creative, experienced and motivated individual to build solutions for integrating CRM and Marketing data in GCP & BigQuery environments.

Responsibilities :

- Build and maintain custom ingestion and integration pipelines from multiple sources (Digital Marketing and CRM data) - 70% (of time)

- Establish monitoring systems to give visibility to pipelines' status and monitor automated jobs. - 10%

- Bringing consistency to our Data handling and schemas across the board. - 5%

- Developing quality standards to ensure data quality and integrity across all database systems. - 5%

- Partner with analysts and data scientists to improve the efficiency and performance of their data products. - 5%

- Where appropriate, train other team members to support the development of products, tools and technologies. - 5%

Experience :

Required :

- 5+ years' experience developing data processing and storage solutions on a cloud architecture; prior knowledge of GCP ecosystem is a major advantage.

- Experience dealing with Digital marketing and CRM data.

- Experience in building pipelines from various data sources especially APIs.

- 2013-2023 SixBerries Ltd Confidential Page 3

Preferred :

- Experience with Python development.

- Experience with using version control via Git and CI/CD systems.

- Demonstrated success as a developer in the full scope of the development lifecycle; including, but not limited to, understanding business needs, design, development, and deployment.

Requirements and skills :

Required :

- Excellent communication and teamwork skills

- A willingness to continually learn and adapt

- Organisational skills

- An analytical mind

- Digital marketing and CRM data pipeline knowledge

- Understands efficient data warehousing designs and schemas.

- Comfortable with ETL tools such as Alteryx, Parabola or Talend

- Highly skilled at writing advanced SQL queries and comfortable with merging complex datasets into functional presentation layers for model inputs.

- Comfortable with working with orchestration tools such as Airflow, Dataproc, dbt or Cloud Composer for ETL and ELT.

Preferred :

- Knowledgeable about data infrastructure management and Unix/Linux operating systems.

- Skilled at deploying containerization solutions such as Docker or Kubernetes.

(ref:hirist.tech)
  • Data Engineer

    5 days ago


    Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    Responsibilities :- Design, develop, and maintain efficient and reliable data pipelines using PySpark.- Implement ETL processes to ingest, transform, and load data from various sources.- Optimize PySpark code for performance and scalability.- Work with large datasets and distributed computing frameworks.- Develop and maintain data quality checks and...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Risk Resources LLP Full time

    Overview : The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Sureminds Full time

    As a Senior Data Engineer, you will be responsible for building and supporting large-scale data architectures that provide information to downstream systems and business users. We are seeking an innovative and experienced individual who can aggregate and organize data from multiple sources to streamline business decision-making. In your role, you will...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Insight Global Full time

    Position : Data Engineer. Location : 100% Remote in India.Shift : Must be able to overlap with US team working 8 : 00am-5 : 00pm EST (Eastern Standard Time). Required Skills & Qualifications : .- 5-7+ years of experience as a Data Engineer.- Proficient in Apache Airflow and Google Cloud Platform (GCP).- Experience creating DAGs and workflows, monitoring...

  • Data Engineer

    5 days ago


    Anywhere in India/Multiple Locations Screatives Software Services Pvt Ltd Full time

    Job Title : Data EngineerExperience : 5 to 8 YearsLocation : RemoteContract : 6 months to 1 yearJob Description :We are seeking a skilled Data Engineer to assist in designing and implementing Snowflake-based analytics solutions on AWS. The ideal candidate will have experience in data lake and data warehouse architecture, data integration, and pipeline...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Patch Infotech Private Limited Full time

    Key Responsibilities : - Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms). - Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Uncap Research Labs Full time

    Key Responsibilities :- Design, implement, and develop data pipelines to collect and process large amounts of data from various sources.- Implement data storage solutions that are scalable, secure, and efficient, such as data warehouses and databases.- Develop and implement data validation and testing processes to ensure that data is processed accurately and...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations CA-One Tech Cloud Full time

    Job Description : Data Engineer (4+ Years Experience) Position : Data Engineer Location : Remote Employment Type : Full-time Experience : 4+ years Start Date : Immediate Job Overview : We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will possess expertise in advanced technologies such as Python, RAG...

  • Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Title : Data Engineer - DBTExperience : 5 - 8 YearsLocation : GurgaonNotice period : 15 DaysJob Type : FTE/C2HWork Mode : RemoteJob Responsibilities : - Assist in the design and implementation of Snowflake-based analytics solution (data lake and data warehouse) on AWS- Requirements definition, source data analysis and profiling, the logical...


  • Anywhere in India/Multiple Locations Appizion Consulting And Solutions Full time

    About the Role :We are seeking a highly skilled and experienced Senior Data Engineer to join our data engineering team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines to support critical business decisions. You will work closely with data scientists, analysts, and engineers to build and...


  • Anywhere in India/Multiple Locations RESURGENT ENTERPRISE SOLUTIONS PRIVATE LIMITED Full time

    Company Overview:Resurgent Enterprise Solutions Private Limited is a leading provider of cutting-edge data engineering solutions.Job Description:We are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will design, build, and manage data pipelines using Azure Data Factory, Azure Databricks, and Azure...


  • Anywhere in India/Multiple Locations Cybyrotek Solutions Full time

    Job Title: Senior Data EngineerCompany Overview: Cybyrotek Solutions is a leading technology company that specializes in providing innovative data engineering solutions to its clients.Job Description: We are seeking an experienced Senior Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining...

  • Lead Data Engineer

    3 days ago


    Anywhere in India/Multiple Locations Zenfinet Full time

    Job OverviewZenfinet is seeking a skilled Databricks Developer to join our team. As a key member, you will be responsible for designing and implementing cutting-edge data engineering solutions using Databricks.About the RoleThis is an exciting opportunity for a motivated professional with experience in data engineering, cloud computing, and big data...


  • Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    About MWIDM Staffing ServicesWe are a leading provider of staffing services, specializing in placing talented professionals in top data engineering roles.Job Description:The ideal candidate will have 5+ years of experience in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations/India Techiebutler Full time

    Job Title : Senior Data Engineer. Employment Type : Full-Time. Experience Required : 5+ Years. About Us : At Techiebutler, we pride ourselves on creating impactful data solutions that power innovative businesses. We are searching for a highly-skilled Senior Data Engineer who thrives in a collaborative environment and brings expertise from working in...

  • Senior Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations Uncap Research Labs Full time

    Key Responsibilities :- Lead and drive discovery sessions with external clients and build state-of-the-art data architectures. - Work with stakeholders to understand their problem statements, data requirements and implement solutions that meet their needs.- Design, implement, and develop data pipelines to collect and process large amounts of data from...


  • Anywhere in India/Multiple Locations Aventior Digital Private Limited Full time

    About the RoleWe are looking for a highly skilled Senior Data Engineering Manager to lead our data engineering team. The successful candidate will have extensive experience in designing and implementing large-scale data ingestion processes, as well as expertise in ETL tools such as SSIS and Azure Data Factory.Key Responsibilities:Manage and lead a team of...


  • Anywhere in India/Multiple Locations Zenfinet Full time

    Job DescriptionLead the design and implementation of cloud-based data architectures for clients across various industries.Collaborate with cross-functional teams to develop innovative data engineering solutions that meet client needs.Mentor junior team members and provide technical guidance on best practices in data engineering.Stay up-to-date with emerging...

  • Big Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Position : Sr Big Data Engineer (GCP)Experience : 5 to 8 YrsLocation : Remote Shift Time : EST Shift (5:30 PM to 2:30 AM)Position Overview : We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful...

  • AWS Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we...