Big Data Developer
9 hours ago
Lead Software Engineer
Locations- Indore, Noida, Hyderabad
Job Description
We are looking for a Lead Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets.
Roles & Responsibilities
Key Responsibilities
- Architect Data Solutions: Design and implement scalable, high-performance big data architectures using industry-leading tools and technologies.
- Lead Development Efforts: Oversee the end-to-end development of big data workflows, pipelines, and applications.
- Mentor Team Members: Provide technical guidance, conduct code reviews, and foster a culture of continuous improvement within the team.
- Optimize Performance: Identify bottlenecks in data processing workflows and implement strategies for optimization.
- Collaborate: Work closely with data scientists, engineers, analysts, and business stakeholders to understand requirements and deliver solutions.
- Data Governance: Ensure compliance with data privacy regulations and best practices in data management.
- Innovate and Stay Current: Research emerging big data technologies and incorporate them into the organization's tech stack as appropriate.
Required Skills and Qualifications
- Big Data Expertise: Experience working with big data technologies like Apache Spark, Hadoop, Hive, and HBase.
- Programming Skills: Advanced proficiency in Python, Scala, or Java, with experience in functional programming.
- ETL and Data Pipelines: Extensive experience in building and optimizing ETL pipelines for large-scale data ingestion and transformation.
- Data Management: Expertise in handling structured and unstructured data in formats like Parquet, Avro, ORC, JSON, and CSV.
- Performance Tuning: Proven ability to optimize distributed computing jobs for resource and cost efficiency.
- Database Knowledge: Proficiency in SQL and NoSQL databases (e.g., PostgreSQL, Cassandra, MongoDB).
- DevOps Integration: Experience with CI/CD pipelines, containerization (Docker), and orchestration (Kubernetes).
- Leadership: Demonstrated ability to lead teams, manage projects, and mentor junior developers.
-
Big data developer
1 day ago
India IITMatrix Full timeWork location : Singapore Mandate skills: Java, microservices, big data, spring boot TEAM Architecture (Big Data) Experience with application development in Big Data Ecosystem (such as Cloudera, Elastic Search, Spark, Presto, Hive, Impala, Kibana, Logstash, Hbase, Kafka), Expertise in building applications using Scala, Java, Python, Shell...
-
Big data developer
4 weeks ago
India Manuh Technologies Full timeBig Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, Py Spark, Impala, SQL Previous experince into big data projects using hadoop and spark. Atleast one project experience into Cloudera hadoop with Impala and Hue Strong Programming experience in Python and Py Spark Hands on experience in SQL using Impala ...
-
Big Data Developer
6 days ago
India Luxoft Full timeProject Description:As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine...
-
Big Data Developer
4 days ago
India Luxoft Full timeProject Description: As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine...
-
Big Data Developer
4 weeks ago
India Manuh Technologies Full timeBig Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQLPrevious experince into big data projects using hadoop and spark.Atleast one project experience into Cloudera hadoop with Impala and HueStrong Programming experience in Python and PySparkHands on experience in SQL using ImpalaExperience in...
-
Big Data Developer
1 month ago
india Manuh Technologies Full timeBig Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQLPrevious experince into big data projects using hadoop and spark.Atleast one project experience into Cloudera hadoop with Impala and HueStrong Programming experience in Python and PySparkHands on experience in SQL using ImpalaExperience in...
-
Big Data Developer
4 weeks ago
India Manuh Technologies Full timeBig Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQL Previous experince into big data projects using hadoop and spark. Atleast one project experience into Cloudera hadoop with Impala and Hue Strong Programming experience in Python and PySpark Hands on experience in SQL using Impala Experience in...
-
Big Data Architect and Developer
2 weeks ago
India Atyeti Inc Full timeAbout Atyeti IncWe are a leading tech company that thrives on innovation. Our mission is to push the boundaries of what is possible in big data technology.Job Title: Big Data Architect and DeveloperThe successful candidate will work closely with our team to design and develop scalable big data solutions using Spark and Hadoop.Salary:$120,000 - $180,000 per...
-
Big Data
3 months ago
india Myananta Technologies Full timeAt Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. Job descriptionFull-Time Big Data (Hadoop) DeveloperMyananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer” Experience: 3 - 5 Years.Salary: 5.0 - 12.0...
-
Big Data Architect
7 months ago
India Princeton IT Services Full time**Job Title**: Big Data Architect **Location**:Kakinada (work from office) or Bangalore (work from office) **Shift**: UK shift preferred **Job Overview**: We are seeking a highly skilled and motivated Big Data Architect to join our team. This individual will play a crucial role in designing and implementing scalable and efficient big data solutions,...
-
Big Data Developer
11 hours ago
India Tata Consultancy Services Full timeDesired Competencies (Technical/Behavioral Competency) Must-Have •5+ years of active development experience with Java, Scala, Spark, Hive, Kafka, NoSql Databases •Having core fundamentals experience of Apache Hadoop components •Understanding best practices for Big Data (in Hadoop), data processing •Strong experience and debugging skills in Java,...
-
Big Data Developer
9 hours ago
India Tata Consultancy Services Full timeDesired Competencies (Technical/Behavioral Competency) Must-Have •5+ years of active development experience with Java, Scala, Spark, Hive, Kafka, NoSql Databases •Having core fundamentals experience of Apache Hadoop components •Understanding best practices for Big Data (in Hadoop), data processing •Strong experience and debugging skills in Java,...
-
Big Data Developer
3 weeks ago
India Quess IT Staffing Full timeExperience as a Big Data Developer and experienced in Data Ingestion with strong track record of designing and implementing data solutions. • Experience in programming language as Python or Java, with experience in building data pipelines and workflows. • Experience with cloud data warehousing technologies, such as Snowflake and Redshift. •...
-
Big Data Engineer
3 weeks ago
India Pert Telecom Solutions Full timeJob Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential...
-
Big Data Developer
1 month ago
india Impetus Full timeF2F Hiring Drive on 16th Nov in Pune.Location: Impetus Technologies India Pvt. Ltd3rd Floor, We Work, Raheja WoodsKalyani Nagar, Pune – 411006 (Maharashtra)Exp: 3.5-6yrsExperience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL, Scala) as appropriateHands-on expertise with application design, software...
-
Senior Big Data Architect
2 weeks ago
India Atyeti Inc Full timeAt Atyeti Inc, we are seeking a highly skilled Senior Big Data Architect to join our team. In this role, you will be responsible for analyzing and processing large datasets using big data technologies and programming languages such as Scala and Java.About the JobThe ideal candidate should have at least 6 years of experience in high-tech industry and/or IT...
-
Big Data Developer
11 hours ago
India Luxoft Full timeProject Description: We've been engaged by a large UK Based Investment Bank in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products . Responsibilities: Ensuring quality service output, submitted in a timely manner and...
-
Big Data Architect
2 months ago
india Affine Full timePrimary Role:Resource and Project Timeline EstimationDefining project and program management processPrioritizing task within project: Task allocation across resources – capable of evaluating resources by their skills and improvement areas - prioritizes resource developmentContributes to org-level activities such as sales collaterals, designing proposals,...
-
Big Data Architect
2 months ago
india Affine Full timePrimary Role : Resource and Project Timeline Estimation Defining project and program management process Prioritizing task within project: Task allocation across resources – capable of evaluating resources by their skills and improvement areas - prioritizes resource development Contributes to org-level activities such as sales collaterals, designing...
-
Senior Big Data Developer
2 months ago
india Synechron Full timeGood-day, We have immediate opportunity for Senior Big Data Developer– 5 to 10 years Job Role : Senior Big Data Developer Job Location : Pune Experience : 5 to 10 years Notice Period : Immediate to 15 Days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines...