Big Data

3 weeks ago

Bengaluru, India Teamware Solutions Full time

Job Description Teamware Solutions is seeking a talented and passionate Big Data Engineer with 2-4 years of experience to join our dynamic team. This role is crucial for designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data. The successful candidate will contribute significantly to ensuring smooth data operations and enabling data-driven insights to meet various business objectives for our clients. Roles and Responsibilities: - Data Pipeline Development: Design, build, and maintain robust and scalable ETL (Extract, Transform, Load) pipelines for ingesting, transforming, and loading large datasets from various sources into Big Data platforms. - Big Data Ecosystem Utilization: Work with and optimize components of the Hadoop ecosystem (e.g., HDFS, Hive) and Apache Spark for distributed data processing and analysis. - Data Processing & Transformation: Develop efficient code using programming languages (e.g., Python, Scala, Java) to perform data manipulation, cleansing, and transformation for analytical purposes. - Database Management: Interact with and manage various databases, including relational (SQL) and NoSQL databases (e.g., Cassandra, MongoDB, HBase), for data storage and retrieval. - Troubleshooting & Optimization: Identify, troubleshoot, and resolve performance bottlenecks and issues within Big Data pipelines and infrastructure. - Data Quality & Governance: Assist in implementing data quality checks and contribute to data governance practices to ensure data accuracy, consistency, and reliability. - Collaboration: Collaborate effectively with Data Scientists, Data Analysts, and other engineering teams to understand data requirements and deliver reliable data solutions. - Monitoring & Support: Monitor Big Data jobs and processes, providing operational support and maintenance for developed solutions. - Continuous Learning: Stay updated with the latest trends and advancements in Big Data technologies and contribute to the adoption of new tools and best practices. Preferred Candidate Profile: - Experience: 2 to 4 years of hands-on experience in Big Data engineering or a related data-centric role. - Big Data Technologies: Practical experience with key Big Data technologies such as Apache Hadoop, Apache Spark, and data warehousing concepts (e.g., Hive). - Programming Skills: Proficiency in at least one programming language relevant to Big Data (e.g., Python, Scala, or Java). - Database Skills: Strong command of SQL for data querying and manipulation. Familiarity with NoSQL databases is a plus. - Cloud Exposure (Plus): Exposure to Big Data services on cloud platforms (e.g., AWS EMR, Azure Data Lake Analytics, Google Cloud Dataproc) is advantageous. - Problem-Solving: Excellent analytical and problem-solving skills with a keen eye for detail in complex data environments. - Communication: Good verbal and written communication skills to effectively collaborate with team members and stakeholders. - Education: Bachelor's degree in Computer Science, Engineering, Data Science, or a related quantitative field.

  • Big Data

    6 days ago

    Bengaluru, Karnataka, India Million IQ Solutions Full time ₹ 8,00,000 - ₹ 10,40,000 per year

    Big Data Developer Big Data environment experience Spark, Hive, Hadoop, HDFS SQL scripting, Python ETL working experience CICD tools, Jenkins JIRA & Confluence experience SAS knowledge as added advantage* Experience:6+ Years Location: Bangalore Max salary: 20 LPA NP: Immediate to 15 Days

  • Itss-big Data/hadoop/splunk Developer-humjp00032981

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 325776 We are currently seeking a ITSS-Big Data/Hadoop/Splunk Developer-HUMJP00032981 to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Azure Data Factory, Azure Synapse, and Databricks **About NTT DATA

  • Big Data

    5 hours ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Big Data Required Technical Skill Set -MS Azure Cloud Platform, Big Data with Hadoop, Python, Hive, Azure data and admin analysisLocation: - Chennai / BangaloreDesired Experience Range: 5 to 12 yearsMust to HaveHands on experience in installation, configuration, supporting and managing Hadoop clusters using Hortonworks...

  • Big Data

    1 week ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the jobAccelerate your career with PradeepITPradeepIT is one of the largest, globally recognized IT Consulting firm to connect Indias deeply vetted talent team to global customer.Were headquartered in Bengaluru, Silicon Valley of India. PradeepITs customers include SAP Lab, Bosch, Rolls-Royce, Daikin, Daimler and J&J and hundreds of other Fortune 500...

  • Big Data

    5 days ago

    Greater Bengaluru Area, India Tata Consultancy Services Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    Greetings from Tata Consulting ServicesTCS is Hiring for Big Data PysparkExperience : 4-10 yearsLocation: BangalorePlease find the JD belowRequired Technical Skill -Big data , Hadoop , Hive , Pyspark, Scala , Python

  • Big Data Developer

    1 day ago

    Bengaluru, India Talent Worx Full time

    We’re hiring for one of the world’s leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, India Acme Services Full time

    Job Description We are actively seeking a skilled Big Data Engineer to join our client's dynamic team through Acme Services. This pivotal role requires solid experience in ETL / Data Engineering / Data Warehousing principles. The ideal candidate will possess strong proficiency in Python, PySpark, and SQL or other ETL tools, along with hands-on experience in...

  • Big data developer

    3 days ago

    Bengaluru, India Sourcebae Full time

    ???? Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala ???? Are you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions. This is a great opportunity...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Whatjobs IN C2 Full time

    Job Title :- Data Engineer - Pyspark Experience: 5 to 8 Years Location: Pune/Hyderabad Job Description Required Skills: 5+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark UI/Optimization/debugging techniques...