Senior Data Engineer
1 month ago
Responsibilities :
Design and build parts of our data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources using the latest Big Data technologies.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Work with machine learning, data, and analytics experts to drive innovation, accuracy, and greater functionality in our data system.
Requirements :
- Bachelor's degree in Engineering, Computer Science, or relevant field.
- 5+ years of experience in a Data Engineer role.
- 5+ years experience with Apache Spark and a solid understanding of the fundamentals.
- Deep understanding of Big Data concepts and distributed systems.
- Strong coding skills with Scala, Python, Java, and/or other languages and the ability to quickly switch between them with ease.
- Advanced working SQL knowledge and experience working with a variety of relational databases such as Postgres and/or MySQL.
- Cloud experience with Data Bricks.
- Experience working with data stored in many formats including Delta Tables, Parquet, CSV, and JSON.
- Comfortable working in a Linux shell environment and writing scripts as needed.
- Comfortable working in an Agile environment.
- Machine Learning knowledge is a plus.
- Must be capable of working independently and delivering stable, efficient, and reliable software.
- Excellent written and verbal communication skills in English.
- Experience supporting and working with cross-functional teams in a dynamic environment.
-
Senior Data Engineer
1 month ago
Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...
-
Senior Engineer
1 month ago
Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full timeImmediately hiring for our client for the role of Senior Engineer Data & Analytics. Total Exp : 8+ years. Location: Anywhere in India. What you'll do:As the senior manager of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment.- Data...
-
Data Engineer
1 month ago
Bangalore, Karnataka, India Magna Hire Full timeResponsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...
-
Senior Data Engineer
3 weeks ago
Bangalore, Karnataka, India TecHHire Global Full timeJob Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...
-
Senior Director
3 weeks ago
Bangalore, Karnataka, India Recruise India Consulting Full timeRole : Senior Director - Data Engineering & AnalyticsResponsibilities :- Provide strategic leadership and vision for the data engineering and analytics function, aligning it with the overall business goals.- Lead and manage a diverse team of data engineers, data architects, data scientists, and cloud operations specialists.- Foster a culture of innovation,...
-
Senior Data Engineer
1 month ago
Bangalore, Karnataka, India Infimetrics Info Solutions Full timePosition : Senior Java (Data Engineer). Reports to : Technical Lead. Responsible for : Contributing to software development as per business requirements.Purpose of Role :- We are a data driven asset management firm with a very wide variety of datasets with varying frequency of updates that essentially drive our research models which ultimately determine the...
-
Senior Data Engineer
2 weeks ago
Bangalore, Karnataka, India Scaling Theory Full timeAs a Senior Data Engineer, you will partner with Software Engineers, Data Scientists, and Business Intelligence Engineers. You will gain a deep understanding of our services and the data they produce and become our resident expert in how to transform that data into a format that is useful for analytics and business intelligence. You will proactively help to...
-
Senior Data Engineer
1 month ago
Bangalore, Karnataka, India SPN Globe Full timeMust Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB.Job Description :1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting capabilities...
-
Senior Data Engineer
1 month ago
Bangalore/Hyderabad, Karnataka, India Sam manpower services & Career LLP Full timeAs a Senior Data Engineer, you will play a critical role in our organization by leading the design, development, and maintenance of our data pipeline infrastructure. You will work closely with cross-functional teams to ensure seamless data integration and accessibility for analytical and operational purposes.Key responsibilities:- Design, construct, and...
-
Senior Data Engineer
10 hours ago
Bangalore, Karnataka, India Web Idea Solution LLP Full timeRole : Senior Data Engineer. Experience : 4-6 years. To be onboarded by : Immediate. Location : Bangalore. Type : Onsite/Full-Time. Responsibilities :- Design and build reusable components, frameworks and libraries at scale to support analytics products.- Design and implement product features in collaboration with business and Technology stakeholders.-...
-
Senior Data Engineer
1 month ago
Bangalore, Karnataka, India D Square Consulting Services Pvt Ltd Full timeJob Description : Role : Senior Data Engineer (DOMO)Experience : 5+ YearsLocation : BangaloreCandidate who can join within 30 days, may only applyWorking Mode : Work From OfficeJob Highlights :Must-Have skills :- 5+ years' experience in ELT systems (Snowflake and DOMO)- Must have experience in digital marketing projects.- Strong knowledge in digital...
-
Senior Data Engineer
1 month ago
Bangalore, Karnataka, India Consulting Pandits Full timeRoles and Responsibilities :- Owning the design, operations and improvements for the Customer Data Warehouse infrastructure- Engineering solutions to aggregate and automate large scale data flows from varying sources- Collaborate with others to construct complex data sources for algorithms and machine learning models- Gather business requirements from...
-
ACL Digital
1 month ago
Bangalore/Hyderabad, Karnataka, India ACL Digital Full timeJob Description :- We are seeking a highly skilled Senior Data Engineer with 3-12 years of experience to join our dynamic team.- As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure to support our analytics and business intelligence initiatives.- You will leverage your expertise in data...
-
Senior Cloud Data Engineer
1 month ago
Bangalore, Karnataka, India Info Origin Inc Full timeJob Description :As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions. Your primary responsibilities will include :Key Responsibilities :- Cloud Data Engineering...
-
Senior Data Engineer
2 weeks ago
Bangalore, Karnataka, India Sentienz Full timeAbout Us : Established in the early months of 2016, Sentienz is an IoT, AI, and big data technology company that you can join. A dynamic team of highly skilled data scientists and engineers who specialize in building internet-scale platforms and petabyte-scale digital insights solutions. We are experts in developing state-of-the-art machine learning models...
-
Senior Data Engineer
10 hours ago
Bangalore, Karnataka, India Zype Full timeAbout Us :Zype is a leading personal loan app that offers a credit line product to its customers. With a focus on convenience and accessibility, Zype provides users with a seamless borrowing experience. By leveraging technology and data analytics, Zype is able to offer competitive rates and flexible repayment options, making it a popular choice among...
-
Senior Palantir Foundry Engineer
3 weeks ago
Bangalore, Karnataka, India RapidBraiins Full timeSenior Palantir Foundry EngineerPosition Overview : We are seeking a highly skilled and experienced Senior Palantir Foundry Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing, developing, and maintaining data models, integrations, and workflows within the Palantir Foundry platform. As a Senior Palantir Foundry...
-
Senior Data Platform Engineer
1 month ago
Bangalore, Karnataka, India Zyoin group Full timeThe Opportunity :We are seeking a highly skilled and experienced Senior Data Platform Engineer to join our dynamic team. You will play a pivotal role in designing, developing, implementing, and maintaining our data platform that supports large-scale data processing and analytics.Responsibilities :- Design, develop, and maintain scalable and robust data...
-
Senior/Staff Software Engineer
1 month ago
Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full timeJob Description : - We are looking for a motivated senior technical leader who wants to have a big impact at a fast-growing Platform company.- You'll work on our cloud data platform and the connectors that bring in data from many sources we support.- We're looking for someone who can understand the key values that make our product great and implement...
-
Senior Manager
10 hours ago
Bangalore, Karnataka, India Avanti staffing Full timeMandatory Experience :- Must have more than 12+ YOE in Software Development, working as an Engineering Manager or aboveMandatory Skills :- Must have good experience in any programming language (eg, Java, Python, Go, NodeJs etc)- Must have Experience in Data / BigData Engineering Technologies. - Any two (e.g.Hadoop, HBase, HDFS, Airflow, Spark, Kafka, AWS,...