Big Data Developer

2 weeks ago

Bengaluru, Karnataka, India PradeepIT Consulting Services Full time


L3 Big data
developer Years)

1. Design, develop, and implement highly scalable and distributed big data
solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and
Spark.

2. Architect HBase schemas and data models to accommodate evolving business
requirements and ensure optimal performance for data storage and retrieval
operations.

3. Develop complex Hive queries and data processing pipelines to transform raw
data into structured formats suitable for analysis and reporting.

4. Implement data ingestion pipelines using Spark Streaming and Spark SQL for
real-time processing of streaming data sources, ensuring high throughput and
low latency.

5. Optimize Spark applications for performance and resource utilization,
including tuning RDD transformations, optimizing data partitioning strategies,
and leveraging in-memory caching.

6. Utilize advanced features of Spark MLlib for machine learning tasks such as
classification, regression, clustering, and collaborative filtering.

7. Design and deploy Kudu tables for fast analytical queries and real-time
analytics, leveraging Kudus unique combination of fast analytics and fast data
ingestion.

8. Collaborate with data scientists to integrate machine learning models into
Spark workflows and productionize them for real-time predictions and analytics.

9. Troubleshoot performance bottlenecks, data quality issues, and system
failures in big data applications and infrastructure, and implement solutions
to address them.

10. Stay abreast of emerging technologies and best practices in big data processing
and analytics, and evaluate their potential impact on our architecture and
solutions.


  • Big Data Developer

    4 days ago

    Bengaluru, Karnataka, India Xebia Full time

    Job Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, OozieBig Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India VidPro Consultancy Services Full time

    Python, pyspark, SQL, DSA, AWS, Hadoop, Hive, Mapreduce and Spark5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and HiveBachelors or masters degree in Computer Science or related fieldStrong knowledge of working with large data sets and high-capacity big data processing platformStrong experience in...

  • Big data Developer

    8 hours ago

    Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time

    The role of Big Data developers involves working extensively with technologies such as Hadoop, Spark, Kafka, and various NoSQL databases. They collaborate with data engineers, data scientists, and business analysts to understand data requirements, optimise workflows, and ensure the reliability and scalability of data platforms. They also implement solutions...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role - Developer - BigData and Hadoop Ecosystems E2Experience Range - 6 to 8 yearsLocation - Bangalore / Chennai / Hyderabad / Mumbai / Indore / AhmedabadMust-Have:Expert in building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time using various...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Workassist Full time

    Work Level: IndividualCore: Result Driven, Adaptable, OrganizedLeadership: Influencing, Decisive, ResponsiveIndustry Type: Software ProductFunction: Software DevelopmentKey Skills: Bigdata,Big Data Platforms,Hadoop,PySpark,SparkEducation: GraduateNote: This is a requirement for one of the Workassist Hiring Partner.Focus : Building applications and...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India CoffeeBeans Full time

    Experience: 5 - 9 YearsLocation: Bangalore/Pune/HyderabadWorkMode: WFO (Hybrid)Note: Should be open for short/medium-term travel opportunities within India & foreign locationFocus:Building applications and solutionsWrites code and develops software applications that process big dataCreates data-driven applications and analytical toolsFocuses on implementing...

  • Big Data Developer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Greetings From Tata Consultancy Services!!! Role: Big Data Developer (Hive, Pyspark) Years of Experience: 4 to 12 yrsLocation: BengaluruNotice Period: 0- 90 daysRoles & Responsibilities:Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools.Should be able to develop, tweak queries and work on performance enhancement.Solid...

  • Big Data

    2 weeks ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    About the jobAccelerate your career with PradeepITPradeepIT is one of the largest, globally recognized IT Consulting firm to connect Indias deeply vetted talent team to global customer.Were headquartered in Bengaluru, Silicon Valley of India. PradeepITs customers include SAP Lab, Bosch, Rolls-Royce, Daikin, Daimler and J&J and hundreds of other Fortune 500...

  • GCP Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Impetus Full time

    ```htmlAbout the CompanyMust have: Bigdata, GCP, Dataproc, Dataflow, SQL, SparkAbout the RoleMust have: Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer services).ResponsibilitiesShould be aware with columnar database e.g. parquet, ORC etc.Visualize...

  • Big Data Developer-Gunjan(HM)

    2 weeks ago

    Bengaluru, Karnataka, India Coders Brain Technology Full time

    Greetings from Coders Brain Technology Pvt. Ltd. Coders Brain is a global leader in its services, digital, and business solutions that partners with its clients to simplify, strengthen, and transform their businesses. We ensure the highest levels of certainty and satisfaction through a deep-set commitment to our clients, comprehensive industry expertise,...