Data Engineer

1 day ago

bangalore, India IntraEdge Full time

Website- Job Title: Data Engineer Experience: 5+Years Location: [Remote] Senior Data Engineer The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders Responsibilities ● Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day. ● Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection ● Design, build and maintain a central data cataloging system to ease integration and discovery of datasets ● Develop data pipelines that provide fast, optimized, and robust end-to-end analytical solutions ● Automate manual processes and create a platform in favor of self-service data consumption ● Deploy and configure components to production environments. ● Participate in on-call schedule to provide emergency incident support ● Mentor and train teammates on design and operation of data platform ● Stay current with industry trends, making recommendations as needed to help the company excel ● Other job-related duties as assigned Skills, Experience and Qualifications ● Bachelor’s Degree in Computer Science or Engineering a plus ● 5+ years of relevant industry experience in Data Engineering working with large scale data driven systems ● Deep knowledge of dimensional modeling and designing schemas and data sets optimized for OLAP environment ● Experience fine-tuning queries around large, complex data sets ● Extensive experience working with an MPP data platform (ie Snowflake, BigQuery, or Databricks)● Experience designing and implementing workflows on a modern orchestration framework (ie Airflow, Prefect)● Advanced Data Build Tool (DBT) experience (ie macro design, generalizing tests, using different incremental strategies)● Deep understanding of SQL and data warehouse systems, especially Snowflake (SnowPro certification preferred)● Experience working with and administering a BI tool (Tableau preferred)● Expertise in object-oriented and/or functional programming languages (Python preferred)● Strong programming skills, able to write modular, maintainable code ● Understanding of DevOps principles such as automating of CI/CD pipelines and Infrastructure as code ● Understanding of polyglot data persistence (relational, key/value, document, column)● Excellent problem-solving skills and the ability to proactively solve issues ● Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines ● Ability to be flexible with working in tandem with a team of engineers or alone, as required

  • Technical specialist

    3 weeks ago

    Bangalore, India NTT DATA, Inc. Full time

    Senior L3+ Network Security Engineer (Fortinet SASE) Job Type: Full-time Experience: 6+ years in network security implementation We are seeking a Senior L3+ Network Security Engineer with 6+ years of hands-on implementation experience in Fortinet SASE/Cybersecurity. The ideal candidate will be responsible for designing, deploying, optimizing, and...

  • Data Engineer

    1 week ago

    bangalore, India BrothersTech Full time

    Title : Data Engineer Location : Remote (Night Shift - Flexible) Contract Duration: 6 months Must have excellent English written and verbal communication skills. The ideal candidate should be experienced in data engineering on Snowflake Azure -ADF, Microsoft MDS, SQL, Data Pipelines with a focus on developing, maintaining the Data Analytics solutions. Job...

  • Data Engineer

    2 weeks ago

    bangalore, India Vista Applied Solutions Group Inc Full time

    Job Summary: Client is looking for Data Engineer and this is hybrid position in Bengaluru. Responsibilities: Data Engineering expertise is required with specific experience in data modeling using Google BigQuery as well as more advanced SQL capabilities. Minimum 5-10 years Data Engineering background, with specific Google BigQuery skills are mandatory....

  • Data Engineer

    1 week ago

    bangalore, India BrothersTech Full time

    Title : Data EngineerLocation : Remote (Night Shift - Flexible)Contract Duration: 6 monthsMust have excellent English written and verbal communication skills. The ideal candidate should be experienced in data engineering on Snowflake Azure -ADF, Microsoft MDS, SQL, Data Pipelines with a focus on developing, maintaining the Data Analytics solutions.Job...

  • Data Engineer

    1 week ago

    bangalore, India ValueLabs Full time

    Job Title: Lead Data Engineer Company: ValueLabs Location: Hyderabad Notice Period : Immediate to 15 Days Job Description: We are seeking a talented Data Engineer to join our dynamic team at ValueLabs. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that support our business operations. This role...

  • Data Engineer

    2 weeks ago

    bangalore, India KPG99 INC Full time

    Role- Databricks Engineer Location- Remote Duration- 12+ months with Extensions REQUIRED SKILLS AND EXPERIENCE - 3–5 years of experience in data engineering roles - Strong hands-on experience with Databricks for data processing and pipeline development. - Proficiency in SQL for data querying, transformation, and troubleshooting. - Solid programming skills...

  • Data Engineer

    2 weeks ago

    bangalore, India AMISEQ Full time

    Data Engineer Bangalore, KA WFO A minimum of 3 years of experience is required. Key Responsibilities Develop and maintain ETL/ELT pipelines using modern data engineering tools and frameworks 7 * 24 On-call support data pipeline health, performance, and SLA compliance Document data processes, schemas, and best practices SOP Implement data quality checks,...

  • Data engineer

    4 weeks ago

    Bangalore, India AMISEQ Full time

    Data Engineer Bangalore, KA WFO A minimum of 3 years of experience is required. Key Responsibilities Develop and maintain ETL/ELT pipelines using modern data engineering tools and frameworks 7 * 24 On-call support data pipeline health, performance, and SLA compliance Document data processes, schemas, and best practices SOP Implement data quality checks,...

  • Data Engineer

    6 days ago

    Bangalore, India Nova Nurture HR Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About the JobSkillsdata lakehousepythonetl pipelinesData Engineeringapache hopDatabasesNoSQLSQLLocation: Bangalore (5 days work from office, HSR Layout)Job Type: Full TimeIndustry: AgritechOpenings: Multiple- junior, mid level etcPython- MandatoryOverviewThe Data Engineer/ Senior Data Engineer will design, develop, and maintain scalable data pipelines and...

  • Data Engineer

    1 week ago

    Bangalore, India Recro Full time

    Role Overview: We are looking for an Azure Data Engineer to design, develop, and optimize data pipelines and solutions on the Azure platform. You will work with business teams to transform raw data into actionable insights. Key Responsibilities: Build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks, and Synapse Analytics Develop data...