Senior Software Engineer – Big Data Hadoop/Hive/Flume
4 days ago
Job profile & responsibilities:
Design, enhance and implement scalable, reliable, and maintainable technologies for our backend data and ETL platform
Distill business requirements into design specifications
Enforce code quality through test driven development.
Ensure that our product is carrier grade in terms of reliability, scalability and performance
Lead efforts in capacity planning
Work closely with the testing team to design intelligent testing strategies
Conceptualize software requirements based on both external and internal inputs
Apply and tailor best practices in software processes and quality to achieve fast cycle time development
Work closely with off shore development teams
Required Qualifications:
BS/MS in Computer Science or a related field
Experience developing software for a high transaction volume, High Availability environment is mandatory.
Prior work experience in online advertising or media industry is a mandatory.
Strong knowledge of data structure, modeling, replication & distributed data/object relational database mapping
Coding and system design using Hadoop, Hive, Flume, Java/J2EE, XML, SOAP, Web Services
In depth expertise in Linux, Apache, Tomcat, Hadoop technologies is mandatory.
Experience with Hadoop, Messaging frameworks like Active MQ, and other scalable technologies used in on-line advertising is required.
Ability to solve complex problems with simple solutions
Strong working knowledge of distributed systems technology; Web based technologies, Application Servers, application and database performance tuning approaches and tools.
Strong empathy for users and customers
Strong technical documentation & presentation skills.
-
Hadoop or AWS Commercial
2 days ago
Chennai, Tamil Nadu, India Mapjects Full time ₹ 4,00,000 - ₹ 6,00,000 per yearCompany Description For our federal client, we are seeking Hadoop (or AWS) developer in the DC-Metro AreaMust email WORD resume to -> DEVIND (@) or -> JOBS @ Compensation is very competitive, and commensurate with experience, loc VA/DCif Corp 2 Corp, 1099, or W2 (please email your expectations, and availability to start) MAP0 Job Description Due to...
-
Data Engineer
5 days ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 9,00,000 - ₹ 12,00,000 per yearHiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...
-
Senior Data Engineer
2 days ago
Chennai, Tamil Nadu, India C1X Full time ₹ 8,00,000 - ₹ 24,00,000 per yearAs a Senior Data Engineer, you will design, build, and scale data platforms and pipelines that power our AdTech ecosystem. You will collaborate closely with product, analytics, and engineering teams to ensure data is accurate, reliable, and actionable for business and product decision-making. This role requires strong technical expertise, problem-solving...
-
Big Data Lead Engineer
2 weeks ago
Chennai, Tamil Nadu, India Synechron Full time ₹ 1,20,000 - ₹ 3,00,000 per yearBig Data Lead Engineer - Hadoop - Spark & GCP (BigQuery/DataProc) with Java & Python ExpertiseJob SummarySynechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutionsThis full-time leadership role involves guiding a team of data engineers and architects to deliver scalable,...
-
Big Data Developer
5 days ago
Chennai, Tamil Nadu, India RB Consultancy Services Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Title:Developer - Big Data (PySpark, HIVE)Work Location:TCS -Bangalore, KA / Chennai, TN / Hyderabad, TGSkills Required:Big Data (PySpark, HIVE)Experience: 4 - 6 YearsJob Description: Big Data (PySpark, HIVE)Need to work as a developer in Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing.Work on Hadoop, Hive SQL's, Spark, and Bigdata Eco...
-
Big Data Developer
2 days ago
Chennai, Tamil Nadu, India Chiselon Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per yearHiringWe are hiring for one of our clientPosition - Big Data Engineer Experience - 5+yearsLocation - Chennai, BangaloreWork Mode - HybridNotice Period - Immediate Joiners(Seving Notice Period within 15days only)Job OverviewWe are seeking a skilled Big Data Developer to join our team in a mid-level position. This full-time, hybrid role is based in Chennai...
-
221142 Staff Software Engineer
2 days ago
Chennai, Tamil Nadu, India Cloudera Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob DescriptionCloudera Data Warehouse Hive team looking for a passionate senior developer to join our growing engineering team. This group is targeting the biggest enterprises wanting to utilize Cloudera's services in a private and public cloud environment. Our product is built on open source technologies like Hive, Impala, Hadoop, Kudu, Spark and so many...
-
Data Engineer
5 days ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...
-
Big Data
2 days ago
Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 6,00,000 - ₹ 18,00,000 per yearRole: Big data EngineerExperience: 6 to 8 YearsLocation: Chennai/Mumbai/Pune Skills:Big DataPysparkHiveLocationChennaiJob FunctionTECHNOLOGYRoleDeveloperJob Id373773Desired SkillsDigital : PySpark | Big Data | HiveDesired Candidate ProfileQualifications : BACHELOR OF ENGINEERING, BACHELOR OF TECHNOLOGY
-
GCP Senior Data Engineer
2 days ago
Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKey responsibilitiesThe role requires a hands-on technologist with expertise in Data Engineering with strong programming background in Hadoop/Hive/Sparks/ScalaShould have hands-on knowledge on GCP cloud platforms.Provide technical leadership and hands-on implementation role in the areas of data engineering including data ingestion, data access, modelling,...