Data Engineer

2 weeks ago

bangalore, India G2 Full time

About The Role

G2 is looking for a Data Engineer - II, you will lead the design, development and maintenance of complex data engineering projects and pipelines for the G2 data platform. You'll lead and contribute significantly to complex data engineering projects and the implementation of complex ETL and ELT processes within an AWS and Snowflake ecosystem, demonstrating expertise in scalable and efficient data processing. This role is located in Bengaluru.

In This Role, You Will: 

Data infrastructure and processing:

Lead the design and development of data pipelines for seamless integration of data from various sources into the G2 Data Platform. Optimize data pipelines, ensuring cost effectiveness, scalability, and reliability. Constantly innovate to make the data stack follow the latest trends. Service data requests from various users of the G2 data platform. Actively contribute to data modeling and design reviews, striving for improved adoption and efficiency. Execute the project tasks aligned with project timelines and objectives under the guidance of senior team members. Develop repeatable and scalable code that processes data to ensure data availability in the platform is as real-time as possible. Actively contribute to the development and advancement of the data platform. Promote architectural changes that increase the scalability of our data infrastructure while maintaining efficiency in all phases of the development lifecycle.

Data quality assurance and governance :

Learn and adopt best practices in data engineering to contribute to robust solutions. Own the implementation of data quality and data governance initiatives and drive them to completion. Recommend and ensure the data platform follows privacy and security standards and requirements. Document data architecture, data model, and workflows for how it should be consumed.

Mentorship and Collaboration :

Guide junior engineers by providing technical support, expertise, best practices, and constructive feedback on data engineering techniques. Collaborate with peers, actively participating in knowledge sharing sessions and contributing to a collaborative team environment. Seek guidance and mentorship from senior team members to enhance technical and analytical skills.

Minimum Qualifications:

We realize applying for jobs can feel daunting at times. Even if you don’t check all the boxes in the job description, we encourage you to apply anyway. 

4+ years of experience as a data engineer or ETL developer. 2+ years of development experience with sound skills in data modeling, optimization, and database architecture. Experience in the design and development of data pipelines using cloud and open-source tools. Proficiency in writing and debugging SQL queries. Good programming skills in Python or Java. Must have good knowledge of performance tuning, optimization and debugging of data pipelines. Working knowledge of the AWS data services (DynamoDB, RDS, Data Pipeline, EMR, Lambda, Glue, ECS, etc.) and cloud data warehouses like SnowFlake. Proficiency in handling structured and unstructured data. Proficiency in ELT/ELT tools like AWS Glue, Step Functions, Data Pipelines, Airflow, Airbyte, and DBT. Familiarity with distributed computing and frameworks like Apache Spark, Hadoop, and Apache Kafka for handling large volumes of data. Familiarity with software engineering principles and best practices.

What Can Help Your Application Stand Out:

Experience with Docker and Kubernetes. Proficiency in data modeling, schema design, and optimizing data structures for performance in Snowflake. Working experience in startup environments. Experience with Agile process methodology, CI/CD automation, Test Driven Development. Knowledge of data governance, security, and compliance standards within cloud-based data solutions. Understanding of any reporting tools such as Tableau, Qlikview ,Looker, PowerBI, etc. Database administration background.

Our Commitment to Inclusivity and Diversity

At G2, we are committed to creating an inclusive and diverse environment where people of every background can thrive and feel welcome. We consider applicants without regard to race, color, creed, religion, national origin, genetic information, gender identity or expression, sexual orientation, pregnancy, age, or marital, veteran, or physical or mental disability status.

We support our employees by offering generous benefits, such as flexible work, ample parental leave, and unlimited PTO.

  • Senior Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services,  Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...

  • Sr data engineer

    2 days ago

    bangalore, India NTT DATA Services Full time

    Req ID:  286326  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data engineer   ...

  • Sr data engineer

    12 hours ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 286326  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    3 weeks ago

    Bangalore, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...

  • Data Architect

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description : Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at Salesforce!We are seeking a Data...

  • Data Engineer

    1 month ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Aptus Data Labs

    2 months ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    2 months ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Data Engineer

    4 weeks ago

    Bangalore, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python   • 8 to 13 years of experience in Data engineering • Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB) • Hands-on experience in Snowflake • Proficient in Data Pipeline Orchestration • Proficient in any one of the programing...

  • Data Engineer

    1 month ago

    bangalore, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python   • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or...

  • Data Architect

    3 weeks ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 281978  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Description:...

  • Data Architect

    4 weeks ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 281978  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Description:...

  • Data Architect

    4 weeks ago

    bangalore, India NTT DATA Services Full time

    Req ID:  281978  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Description: Data...

  • Staff Engineer

    3 weeks ago

    bangalore, India Hevo Data Full time

    About Hevo Data: Unleash the power of data at Hevo! Join our team of brilliant minds as we revolutionize the world of data connectivity. Our mission is simple: to empower organisations with seamless access to their data universe, enabling smarter decisions and unlocking their full potential. Are you ready to be part of the data revolution that is shaping the...

  • Solutions Engineer

    4 hours ago

    bangalore, India Hevo Data Full time

    About HevoHevo is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Doordash, Footlocker, Arhaus, Santander, and thousands of other data-driven companies share one thing. They all use Hevo Data’s fully managed Automated Pipelines to consolidate their data...

  • Solutions Engineer

    24 hours ago

    bangalore, India Hevo Data Full time

    About Hevo Hevo is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics. Doordash, Footlocker, Arhaus, Santander, and thousands of other data-driven companies share one thing. They all use Hevo Data’s fully managed Automated Pipelines to consolidate their...

  • Digital Engineering Sr. Engineer

    3 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Req ID:  274457  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Bangalore, Karnātaka (IN-KA),...