Data Engineer

1 month ago

Bengaluru, India Robosoft Technologies Full time
Job Summary

We are looking for a Data Engineer (full-time, salary, regular) to join our team. The BI data engineering team is responsible for collecting, analyzing and distributing data using public cloud and open source technologies and offers transparency into customer behavior and business performance


Responsibilities
Collaborate with product teams and data analysts to design and build data-forward solutions Build and deploy streaming and batch data pipelines capable of processing and storing petabytes of data quickly and reliably Integrate with a variety of data metric providers ranging from advertising, web analytics, and consumer devices Build and maintain dimensional data warehouses in support of business intelligence tools Develop data catalogs and data validations to ensure clarity and correctness of key business metrics Drive and maintain a culture of quality, innovation and experimentation Deliver strong Python and SQL development and maintenance techniques surrounding data movement to include technologies Investigate and understand different data sources and ability to connect to a wide variety of 3rd party APIs Design, enhance and implement ETL/data ingestion platform on the cloud Development of ETL source and target mapping design/specifications based on the business requirements. Create ETLs/ELTs to take data from various operational systems and create a unified/enterprise data model for analytics and reporting Develop load and transformation processes in support of the requirements, validate that they meet business and technical specifications, manage ongoing maintenance of the system and data, and make recommendations for process improvements to optimize data movement from source to target Provide production and operational support to existing ETL jobs. Monitor and manage production ETL jobs to verify execution and measure performance to assure ongoing data quality and optimization of the system to manage scalability and performance and identify improvement opportunities for key ETL processes Strong troubleshooting and problem-solving skills in large data environment Capable of investigating, familiarizing and mastering new data sets quickly
Supervisory Responsibility

This position will not include supervising one or more employees where applicable.


Education/Experience
Bachelor’s degree – Computer Science or equivalent Strong background in scripting language using Python, Bash, Perl, PHP or any other language to solving data problems ( At least worked on any one) Experience with relational SQL and NoSQL databases, including Postgres, ,Neo4j and MongoDb Experience with Big Data tools; Hadoop, Spark, Kafka, Hive etc ( At least worked on any one) Proficiency with data exchange types and protocols (json, xml, soap, rest) Experience with Stream Processing systems: Apache Storm ,Spark-Streaming etc ( At least worked on any one) Experience with BI tools like Tableau or any other open source BI tools etc Proficiency with the AWS cloud services : EC2, EMR, RDS, S3, Redshift (spectrum) Exposure to cloud platforms (preferably AWS)
Knowledge, Skills, & Abilities
Knowledge of the Python data ecosystem using pandas and numpy Data integration tools Proficiency in SQL, data modeling, and data warehousing Excellent problem solving skills Exposure to cloud platforms (preferably AWS)
Equipment/Software Used
Microsoft Office Suite (Outlook, Word, Excel, PowerPoint) SQL, MySQL or other relational databases Linux, Python, AWS Stack (EC2,EMR S3, Redshift) Tableau or any other data visualization tool SiteCatalyst (Omniture)/Google Analytics or any other web analytics tools experience (Nice to have)

  • Aptus Data Labs

    3 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Data Engineer

    2 days ago

    Bengaluru, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Data Engineer

    3 days ago

    Bengaluru, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Data Engineer

    7 days ago

    Bengaluru, India ANZ Full time

    About the roleData Engineer –Role Type – FTEJob Grade: Group 4.3At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe. The Australia Data tribe sits within our Australia Commercial division and our mission is to combine business & technology...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    7 days ago

    Bengaluru, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data EngineerData EngineerReq ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: BengaluruAbout the roleData Engineer –Role Type – FTEJob Grade: Group 4.3At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe....

  • Data Engineer

    2 weeks ago

    Bengaluru, India Ascendion Full time

    Job Title: Data Engineer/ LeadDuration: Full TimeLocation: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid)NOTE: Looking for Immediate Joiners ( 2-3 weeks notice)Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks.Familiarity with Kubeflow, with a preference on hands-on experience.Strong proficiency in Python programming for data...

  • Data Engineer

    7 days ago

    Bengaluru, India Aryng Full time

    Welcome! You made it to the job description page!Aryngis looking for aSenior Data Engineerwith experience in developing enterprise-class distributed data engineering solutions on the cloud. We are seeking an entrepreneurial and technology-proficientData Engineerwho is an expert in theimplementation of a large-scale, highly efficient data platform, batch, and...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NatWest Group Full time

    Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and...

  • Data Engineer

    3 weeks ago

    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    4 weeks ago

    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Ascendion Full time

    Job Title: Data Engineer/ LeadDuration: Full TimeLocation: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid)NOTE: Looking for Immediate Joiners ( 2-3 weeks notice)- Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks.- Familiarity with Kubeflow, with a preference on hands-on experience.- Strong proficiency in Python programming for data...

  • Data Engineer, IN Data Engineering

    1 month ago

    Bengaluru, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses. IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing...

  • Data Engineer

    4 days ago

    Bengaluru, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role DescriptionThis is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehousing, and data analytics. The role is based in Bengaluru, with flexibility for some...

  • Data Engineer, IN Data Engineering

    4 weeks ago

    Bengaluru, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses.IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing Unified...

  • Data Engineer

    2 days ago

    Bengaluru, India Joveo Full time

    Role:Data EngineerLocation:Hybrid (Bangalore/Hyderabad)About JoveoJoveo was founded in 2017 by a group of visionary entrepreneurs and enthusiastic problem solvers who foresaw the need for greater transparency and predictability in recruitment marketing. The focus was on building a cutting-edge technology platform that uses data and machine learning to enable...

  • Data Engineer

    4 weeks ago

    Bengaluru, India Analog Devices Full time

    Gather business and functional requirements and translate into robust scalable, solutions aligned to the Data Architecture guidelinesHands on development work on all aspects of data analysis, data provisioning, Data modeling, performance tuning and optimizationDesign, implement and operate large scale, high volume, high performance data structures for...

  • Data Engineer

    4 weeks ago

    Bengaluru, India Yara Full time

    ResponsibilitiesParticipate in designing and building data pipelines to collect, manage and store data across different solutions and tools where the data resides for the YAA teams.Monitor, manage and maintain data pipelines as part of the day-to-day data operations.Build data mart tables for various use cases by working with the different data consumers...

  • Data Engineer

    1 week ago

    Bengaluru, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data Engineer Data Engineer Req ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: Bengaluru About the roleData Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia...

  • Data Engineer

    2 days ago

    Bengaluru, India RaaGaa Value Add Technologies. Full time

    Key Responsibilities:1.Design, develop, and maintain scalable data pipelines and ETL processes to extract, transform, and load large volumes of structured and unstructured data from diverse sources in Batch and Real-time processing.2.Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to...