Big Data Lead
7 days ago
About Persistent
We are a trusted Digital Engineering and Enterprise Modernization partner. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above.
Our Team
We work with many industry-leading organizations across the world. Our growth trajectory continues, as we reported $1,186M annual revenue (13.2% Y-o-Y). Along with our growth, we've onboarded over 4900 new employees in the past year, bringing our total employee count to over 23,850+ people located in 21 countries across the globe.
About the Position
We are looking for a Big Data Lead who will be responsible for the management of data sets that are too big for traditional database systems to handle. You will create, design, and implement data processing jobs in order to transform the data into a more usable format.
Key Responsibilities
- Manage customer's priorities of projects and requests
- Assess customer needs utilizing a structured requirements process (gathering, analyzing, documenting, and managing changes) to prioritize immediate business needs and advising on options, risks and cost
- Design and implement software products (Big Data related) including data models and visualizations
- Demonstrate participation with the teams you work in
- Deliver good solutions against tight timescales
- Be pro-active, suggest new approaches and develop your capabilities
- Share what you are good at while learning from others to improve the team overall
- Show that you have a certain level of understanding for a number of technical skills, attitudes and behaviors
Requirements
- 6 years' experience in designing & developing enterprise application solution for distributed systems
- Understanding of Big Data Hadoop Ecosystem components (Sqoop, Hive, Pig, Flume)
- Additional experience working with Hadoop, HDFS, cluster management, Hive, Pig and MapReduce, and Hadoop ecosystem framework, HBase, Talend, NoSQL databases
- Apache Spark or other streaming Big Data processing, preferred
- Java or Big Data technologies, will be a plus
We Offer
- Competitive salary and benefits package
- Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
-
Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full timeAWS Big Data EngineerWe are seeking an experienced AWS Big Data Engineer to join our team at D-TechWorks Pvt Ltd. As a key member of our delivery team, you will be responsible for designing, developing, and validating big data solutions using AWS technologies.Key Responsibilities:Design and develop scalable big data architectures using AWS services such as...
-
Data Engineer for Big Data
2 weeks ago
Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full timeAbout the Role:At D-TechWorks Pvt Ltd, we are seeking a skilled Data Engineer for Big Data to join our team. As a key member of our delivery team, you will be responsible for ensuring effective design, development, validation, and support activities in line with client needs and architectural requirements.About the Position:This is a Remote Big Data Position...
-
Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full timeAWS Big Data Engineer Job DescriptionWe are seeking a highly skilled AWS Big Data Engineer to join our team at D-TechWorks Pvt Ltd. As a key member of our delivery team, you will be responsible for designing, developing, and supporting big data solutions using AWS technologies.Key Responsibilities:Design and develop big data architectures using AWS services...
-
Senior Big Data Engineer
2 weeks ago
Anywhere in India/Multiple Locations US Technology International Pvt Ltd Full timeJob Title: Senior Big Data EngineerJob Summary:US Technology International Pvt Ltd is seeking a Senior Big Data Engineer to lead the development and implementation of big data solutions. The ideal candidate will have expertise in Hadoop, Spark, and other big data technologies, as well as strong leadership and communication skills.Key Responsibilities:Design,...
-
Persistent Systems
2 weeks ago
Anywhere in India/Multiple Locations Persistent Systems Full timeAbout Persistent : We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with...
-
Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations US Technology International Pvt Ltd Full timeJob Title: Senior Big Data DeveloperJob Summary:We are seeking a highly skilled Senior Big Data Developer to join our team at US Technology International Pvt Ltd. The ideal candidate will have a strong background in big data technologies, including Hadoop/Spark, and experience in developing scalable and efficient data processing...
-
Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Stratosphere IT Services PVT Ltd Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Stratosphere IT Services PVT Ltd. As a Big Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on Microsoft Azure.Key Responsibilities:Design and implement scalable data ingestion...
-
Big Data Engineer
1 month ago
Anywhere in India/Multiple Locations, IN D-TechWorks Pvt Ltd Full timeWe are looking for Aws big data engineer In Remote , India Position : Aws big data engineerExperience : 7 to 9 YearLocation : Remote , India Mandate skills : BigData Python Pyspark AWS Glue Airflow Redshift Responsibilities :- Ensure effective Design, Development, Validation and Support activities in line with client needs and architectural requirements.,-...
-
Lead Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations, IN Talentoj Full timeRequirements : - 6+ years' experience with Big Data Technologies such as Apache Spark, Cloud Native, and Data Lakes, and Databricks. - Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration, and data management. - Implemented batch ingestion pipelines. - Strong Python skills - automate tasks, write unit tests...
-
Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Stratosphere IT Services PVT Ltd Full timeJob Title: Big Data Engineer - Azure Data SolutionsJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Stratosphere IT Services PVT Ltd. As a Big Data Engineer, you will be responsible for designing and building scalable data ingestion pipelines, conceptualizing and executing high-performance data processing for structured and...
-
Big Data Engineer
2 weeks ago
Anywhere in India/Multiple Locations IT Source Global Full timeJob SummaryWe are seeking a skilled Hadoop Developer to join our team at IT Source Global. As a Hadoop Developer, you will be responsible for designing and developing complex data pipelines for ingestion, transformation, and processing of structured and unstructured data.Key ResponsibilitiesDevelop, implement, and maintain large-scale data processing...
-
Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations IT Source Global Full timeJob Title: Hadoop DeveloperWe are seeking a skilled Hadoop Developer to join our team at IT Source Global.Job Summary:The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing applications using Hadoop and related Big Data technologies.Key Responsibilities:Design and develop complex data pipelines for...
-
Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Coders Brain Technology Pvt. Ltd. Full timeJob Title: Big Data EngineerAbout the Role:Coders Brain Technology Pvt. Ltd. is seeking a highly skilled Big Data Engineer to join our modernization initiative team. As a key member of our team, you will be responsible for designing and implementing efficient data handling systems based on Java and Spark.Key Responsibilities:Design and implement data...
-
Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Coders Brain Technology Pvt. Ltd. Full timeJob Title: Big Data EngineerJob Summary:Coders Brain Technology Pvt. Ltd. is seeking a highly skilled Big Data Engineer to join our modernization initiative team. The ideal candidate will have experience with Java, Spark, and Spring Boot, and will be responsible for designing and implementing efficient data handling systems, performing tasks such as...
-
Senior Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations US Technology International Pvt Ltd Full timeJob Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at US Technology International Pvt Ltd.Key Responsibilities:Design and develop large-scale data processing systems using Hadoop/Spark.Collaborate with cross-functional teams to integrate data processing systems with existing infrastructure.Develop and...
-
Anywhere in India/Multiple Locations DRIVETRAIN AI TECHNOLOGIES PRIVATE LIMITED Full timeDrivetrain is on a mission to empower businesses to make better decisions. Our financial planning & decision-making platform helps companies scale and achieve their targets predictably.Drivetrain is a remote-first company headquartered in the San Francisco Bay Area. Founded in 2021 by a couple of ex-Googlers, Drivetrain is a fast-growing company on a...
-
Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations/Remote Hum Technologies Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Hum Technologies. The successful candidate will be responsible for designing and implementing data pipelines, troubleshooting, and mentoring.Key Responsibilities:Design and implement data pipelines using Hadoop, Spark, and other big data...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations LYTX Full timeJob Description:We are seeking a highly skilled Staff Data Engineer to join our team at Lytx. As a key member of our data engineering team, you will be responsible for designing and developing rich data-driven frameworks, applications, and services.Key Responsibilities:Participate in the full software lifecycle, including requirements, design, code, unit...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Innotatz IT Solutions Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Innotatz IT Solutions. As a Data Engineer, you will play a crucial role in designing and implementing robust data pipelines to collect, connect, and curate data from various sources.Responsibilities:Design and develop scalable data pipeline architectures to meet...
-
Senior Data Engineer
1 month ago
Anywhere in India/Multiple Locations HNM Solutions Full timeRole : Senior Data Engineer (Databricks) Location : Remote, India Experience : 8+years Note : Immediate : - Enforce adherence to architectural standards, global product-specific guidelines, and usability design standards. - Proactively guide engineering methodologies, standards, and leading practices. - Identify, communicate, and mitigate risks,...