Data Engineer II
2 months ago
SALARY : 15LPA - 20LPA
Posting title : Data Engineer II
Experience : 6+ Years
Location : Bangalore
Work mode : Hybrid
Primary skills : ETL, Data Warehousing, Reporting, SQL, Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Storage, etc.
Qualification : Any Engineering/ Computers degree
Roles & Responsibilities :
- Design, implement, and manage scalable and efficient data architecture on the Azure cloud platform.
- Develop and maintain data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
- Perform complex data transformations and processing using Azure Data Factory, Azure Databricks, Snowflake's data processing capabilities, or other relevant tools.
- Develop and maintain data models within Snowflake and related tools to support reporting, analytics, and business intelligence needs.
- Collaborate with cross-functional teams to understand data requirements and design appropriate data integration solutions.
- Integrate data from various sources, both internal and external, ensuring data quality and consistency.
- Ensure data models are designed for scalability, reusability, and flexibility.
- Implement data quality checks, validations, and monitoring processes to ensure data accuracy and integrity across Azure and Snowflake environments.
- Adhere to data governance standards and best practices to maintain data security and compliance.
- Handling performance optimization in ADF and Snowflake platforms
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver actionable insights.
- Provide guidance and mentorship to junior team members to enhance their technical Skills.
- Maintain comprehensive documentation for data pipelines, processes, and architecture within both Azure and Snowflake environments including best practices, standards, and procedures.
Skills & Knowledge :
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 5 + Years of experience in Information Technology, designing, developing and executing solutions.
- 3+ Years of hands-on experience in designing and executing data solutions on Azure cloud platforms as a Data Engineer.
- Strong proficiency in Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Storage, etc.
- Familiarity with Snowflake data platform would be an added advantage.
- Hands-on experience in data modelling, batch and real-time pipelines, using Python, Java or JavaScript and experience working with Restful APIs are required.
- Expertise in DevOps and CI/CD implementation.
- Hands-on experience with SQL and NoSQL databases.
- Hands-on experience in data modelling, implementation, and management of OLTP and OLAP systems.
- Experience with data modelling concepts and practices.
- Familiarity with data quality, governance, and security best practices.
- Knowledge of big data technologies such as Hadoop, Spark, or Kafka.
- Familiarity with machine learning concepts and integration of ML pipelines into data workflows
- Hands-on experience working in an Agile setting.
- Is self-driven, naturally curious, and able to adapt to a fast-paced work environment.
- Can articulate, create, and maintain technical and non-technical documentation.
- Public cloud certifications are desired
-
Software Development Engineer II
2 months ago
Bangalore, Karnataka, India HEVO DATA Full timeAbout Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...
-
Solution Engineer
2 months ago
Bangalore, Karnataka, India HEVO DATA Full timeOverview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India Easy Recruitz Full timeData engineer : Hadoop. Location : Bangalore (Hybrid). We are looking for an Engineer II to join our growing team of data experts. This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics. The Engineer will work closely with product partner,...
-
Systems Engineer II
2 months ago
Bangalore, Karnataka, India TETRAHED INC Full timeSystems Engineer - IIKey Responsibilities : - Work closely with product manager and developer to understand product requirement and design.- Document detailed functional and integration test cases. - Coordinate with the developer, product manager and other business stakeholders on test case review, identify missing and complex test case scenarios.- Test...
-
Software Engineer II
5 months ago
Bangalore, Karnataka, India PureSearch Full timeWe seek a highly skilled and experienced Software Engineer II to join our client's dynamic backend team. This role is pivotal in designing and executing low-level solutions for various product features, ensuring our products remain cutting-edge and highly reliable. If you are passionate about creating impactful solutions and thrive in a fast-paced,...
-
Software Development Engineer II
1 month ago
Bangalore, Karnataka, India Anzyglobal Full timeJob Description :As our Software Development Engineer II - Golang, you will be an integral part of our growing engineering team, taking ownership of core modules. Success in this role requires strong communication, interpersonal, technical, and analytical skills, enabling you to actively participate in the collaborative and cooperative development process...
-
Analog Validation Engineer II
2 months ago
Bangalore, Karnataka, India One Degree North HR Services Full timeJob Title : Validation Engineer Analog II /- 8-12yrs-. Location : BangaloreTarget domain : Analog Design Flow. Key skills : scripting, manual testing, test automation, Linux, EDA, IC Design Context :- NXP Semiconductors enables secure connections and infrastructure for a smarter world, advancing solutions that make lives easier, better, and safer.- As the...
-
Shadowfax Technologies
2 months ago
Bangalore, Karnataka, India Shadowfax Technologies Pvt Ltd Full timeROLE : Senior Data Scientist/Data Scientist-IIWHAT YOU WILL DO :- Business understanding, Data understanding/preparation, Modeling, Evaluation and Deployment of solutions.- Write high-quality production code as you build and maintain robust, scalable machine learning systems.- Develop, validate and deploy ML models, optimization solutions, inference...
-
Senior Software Engineer
1 month ago
Bangalore, Karnataka, India Freelancer Recruiter Full timeDesired Skills & Qualifications :- Deep understanding of algorithms and data structures.- Should have worked with MVC frameworks, web / client based server architecture, structured and unstructured databases.- Ability to translate product spec to engineering actionables.- Ability to navigate and structure code bases.- Rudimentary skills around service...
-
The Math Company
2 months ago
Bangalore, Karnataka, India The Math Company Full timeJob Description :- Showcase strong analytical and problem-solving capabilities by consulting with clients and other stakeholders to understand business problems.- Responsible for designing, storing, processing, and maintaining of large scale data and related infrastructure.- Is a developer who is responsible to build data pipelines, implement data quality,...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India Prydan Consultancy Full timeCompany Description : PRYDAN Consultancy Services is a global staffing solutions provider committed to excellence in recruitment services across various industries. With a focus on matching the right talent with the right opportunities, we empower clients and candidates to thrive in today's competitive landscape. Our comprehensive recruitment services...
-
Full Stack Engineer II
2 months ago
Bangalore, Karnataka, India Uniqode Full timeThe Uniqode story :Uniqode (formerly Beaconstac) started out as a way to solve the disconnect between the physical and digital worlds by leveraging technology. The solution was to deliver proximity marketing experiences using QR Codes, NFC tags, and Bluetooth beacons.Over the last few years, Uniqode became the chosen platform for over 50,000 businesses...
-
Rocket Software
2 months ago
Bangalore, Karnataka, India Rocket Software Development India Private Limited Full timeJob Description :The Software Engineer-II will design, develop, troubleshoot, and debug software programs for both enhancements and new product development. You will be responsible for developing software tools, including but not limited to operating systems, compilers, routers, networks, utilities, databases, and internet-related tools. The role requires...
-
Data Engineer
1 month ago
Bangalore, Karnataka, India Consero Global Solutions Full timeWe are seeking experienced, motivated and enthusiastic Data Engineering Specialists to join our team. As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company and contribute to our mission of delivering high-quality data-driven solutions to our clients. Role Description : The data engineering role...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India Creencia Technologies Pvt Ltd Full timeJob Description:We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in Data Engineering, with expertise in building and managing data pipelines. Proficiency in Scala programming, as well as experience with Java, GCP, and Spark, is essential for this role.Salary : 14-18 LPA Responsibilities :- Design,...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India Coders Brain Technology Private Limited Full timeRole : Data Engineer (no one over 10 years of experience will be considered)Qualifications :- Bachelor's degree in Computer Science/Engineering or similar- 5 to 7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines- Proficiency with Cloud Platforms like Azure(preferred), AWS,...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India Spigot Software Full timeResponsibility :- Design, develop, and maintain scalable data pipelines and analytics solutions using DBT, Snowflake, and related technologies- Collaborate with stakeholders to gather requirements and translate business needs into technical solutions- Develop efficient code with unit testing and code documentation- Ensuring accuracy and integrity of data and...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India BlueByte Technologies Full time1. Design and Develop ETL Pipelines :- Extract, transform, and load data from various sources into the data warehouse.- Ensure data integrity and quality throughout the ETL process.2. Data Warehousing :- Design and maintain data models, schemas, and database structures.- Optimize data storage and retrieval for performance and scalability.3. Complex SQL...
-
Lead Data Engineer
2 months ago
Bangalore, Karnataka, India Sentienz Full timeJob Description : As a Lead Data Engineer, you will play a pivotal role in driving our data-driven initiatives. You will be responsible for designing, developing, and maintaining robust data engineering solutions that support our analytics and decision-making processes.Responsibilities :- Lead and mentor a team of data engineers, providing technical guidance...
-
Head - Data Engineering
4 weeks ago
Bangalore, Karnataka, India Merck Group Full timeJob Description : Join us to contribute to the org's enterprise priority of driving innovation through data & digital. In R&D, the promise of bringing more medicines to more patients faster is closely linked with the ability to maximize the use of our data for improved decision making using data analytics & AI. For this, having high-quality data readily...