Data Engineer

3 weeks ago

Bangalore, Karnataka, India Grizmo Labs Full time

Responsibilities :

- Develop, construct, test, and maintain architectures such as large-scale processing systems, and other infrastructure using tools and technologies such as Hadoop, Spark, and Kafka.

- Assemble large, complex data sets that meet functional / non-functional business requirements, utilizing SQL, NoSQL, and cloud-based data warehousing solutions such as Amazon Redshift or Google BigQuery.

- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc, using Python and PySpark.

- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and cloud-based big data technologies like Apache Flink.

- Create and design Data Lake with AWS Services like S3 Lambda, Step Functions, Cloud Formation, Kinesis, and Firehose.

- Working knowledge of Apache Superset and Airbyte.

- Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data engineering needs using data visualization tools like Tableau, Superset, Indicative

- Create data tools for analytics and data engineering team members that assist them in building and optimizing our product into an innovative industry leader, using machine learning frameworks like TensorFlow, PyTorch, or Scikit-Learn.

- Create segmentation using graph databases and knowledge with tools like Neo4j, AWS Neptune, or GraphQL.

- Document and communicate data engineering solutions and methodologies using tools like Confluence, and Jira.

- Assess and implement new data engineering tools and technologies to stay ahead in the industry.

- Troubleshoot and solve issues in the data engineering infrastructure using monitoring and debugging tools like ELK Stack.

Requirements :

- The candidate should have at least 3-5 years of experience in building AWS Data Platform Solutions or relative BI Experience.

- Experience in building and optimizing data pipelines using AWS/DBT ETL tools.

- Experience with Superset, Airbyte, AWS S3 Lambda, Step Functions, AWS Redshift.

- Experience in designing and deploying data platforms for supporting various data use cases including batch analysis, and real-time analytics.

- Experience using Python, PySpark, Kinesis, Firehose, and Kafka for real-time streaming analytical solutions.

- Experience in Data governance frameworks.

- Experience in MySQL and Python.

- Experience in Optimization of queries.

- Good understanding of Data warehousing concepts.

- Experience in Tableau, Hadoop, and AI/ML Data modeling.

- Experience in Hive, Hbase, and EMR clusters.

(ref:hirist.tech)

  • Aptus Data Labs

    4 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Aptus Data Labs

    3 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Staff Engineer

    2 months ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Staff Engineer

    3 weeks ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Programming.com Full time

    Job Description :This is a full-time on-site role as an AWS Data Engineer located in Bengaluru. The AWS Data Engineer will be responsible for daily tasks including data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. Qualifications :- Data Engineering and Data Modeling skills- Experience with Extract Transform...

  • Kafka Data Engineer

    2 months ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Kafka Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Smartgig Technologies Private Limited Full time

    Data Engineer (6+ Years Experience)Location : Bangalore, HybridAvailability : Immediate to 15 DaysAbout the Role :We are seeking a highly skilled Data Engineer with over 6 years of experience to join our dynamic team in Bangalore. The ideal candidate will have extensive experience with Python and PySpark, along with a strong understanding of data engineering...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Python Data Engineer

    2 months ago

    Bangalore, Karnataka, India Cyitechsearch Full time

    A Python Data Engineer job description typically includes the following responsibilities, qualifications, and skills:Job Description :Responsibilities :- Develop and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into data lakes, warehouses, or databases.- Design, build, and optimize data models and schemas to...

  • Software Engineer

    3 weeks ago

    Bangalore, Karnataka, India Talent Xo Full time

    Experience Requirement :- 6 to 13 years of experience in Software Engineering, with a focus on Data and Big Data technologies.- Proven track record of designing, implementing, and maintaining data engineering solutions with high scalability and reliability.Core Skills :- Experience in Data/Big Data Engineering Technologies :- Proficiency in one or more...

  • Software Engineer

    4 weeks ago

    Bangalore, Karnataka, India Talent Xo Full time

    Experience Requirement :- 6 to 13 years of experience in Software Engineering, with a focus on Data and Big Data technologies.- Proven track record of designing, implementing, and maintaining data engineering solutions with high scalability and reliability.Core Skills :- Experience in Data/Big Data Engineering Technologies :- Proficiency in one or more...

  • Azure Data Engineer

    4 days ago

    Bangalore, Karnataka, India Firstcareercentre Full time

    Key Responsibilities :As an Azure Data Engineer, you will be responsible for designing, implementing, and managing data solutions using Microsoft Azure services. You will work closely with our data science, analytics, and development teams to ensure our data infrastructure is robust, scalable, and efficient.Key Responsibilities :- Design and develop data...