Big Data Solutions Architect

1 day ago

Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

Job Title: Big Data Solutions Architect

">

About the Role:

"

We are seeking a highly skilled and experienced Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing complex data solutions using Azure Data Factory, Azure Databricks, and Cosmos DB.

"""

The ideal candidate should possess deep expertise in big data technologies, data integration, and cloud-native data engineering solutions on Microsoft Azure. This role involves working closely with data architects, testers, and analysts to deliver robust data solutions that support strategic business initiatives.

""

Key Responsibilities:

""
  • Data Solution Design and Development:
  • Design and develop scalable and high-performance data pipelines using Azure Data Factory (ADF).
  • Implement data transformations and processing using Azure Databricks.
  • Develop and maintain NoSQL data models and queries in Cosmos DB.
  • Optimize data pipelines for performance, scalability, and cost efficiency.
  • Data Integration and Architecture:
  • Integrate structured and unstructured data from diverse data sources.
  • Collaborate with data architects to design end-to-end data flows and system integrations.
  • Implement data security, governance, and compliance standards.
  • Performance Tuning and Optimization:
  • Monitor and tune data pipelines and processing jobs for performance and cost efficiency.
  • Optimize data storage and retrieval strategies for Azure SQL and Cosmos DB.
  • Collaboration and Mentoring:
  • Collaborate with cross-functional teams including data testers, architects, and business analysts.
  • Conduct code reviews and provide constructive feedback to improve code quality.
  • Mentor junior developers, fostering best practices in data engineering and cloud development.
"""

Primary Skills:

""
  • Big Data Engineering: Azure Data Factory (ADF), Azure Databricks.
  • Cloud Platform: Microsoft Azure (Data Lake Storage, Cosmos DB).
  • Data Modeling: NoSQL data modeling, Data warehousing concepts.
  • Performance Optimization: Data pipeline performance tuning and cost optimization.
  • Programming Languages: Python, SQL, PySpark
"""

Secondary Skills:

""
  • DevOps and CI/CD: Azure DevOps, CI/CD pipeline design and automation.
  • Security and Compliance: Implementing data security and governance standards.
  • Agile Methodologies: Experience in Agile/Scrum environments.
  • Leadership and Mentoring: Strong communication and coaching skills for team collaboration.
"""

Soft Skills:

""
  • Strong problem-solving abilities and attention to detail.
  • Excellent communication skills, both verbal and written.
  • Effective time management and organizational capabilities.
  • Ability to work independently and within a collaborative team environment.
  • Strong interpersonal skills to engage with cross-functional teams.
""",

  • Solutions Architect

    3 days ago

    Chennai, Tamil Nadu, India Optimum Solutions Pte Ltd Full time

    15+ years of experience with application developments, 7+ years of experience in solutioning & Architecture7+ Years Having strong knowledge in banking technology domain with at least 5+ years of experience in solutioning banking applications.Expert knowledge of multi cloud Azure, AWS & GoogleExperience of migrating and deploying cloud-based...

  • Itss-big Data/hadoop/splunk Developer-humjp00032202

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 317271NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a ITSS-Big Data Hadoop Splunk Developer-HUMJP00032202 to join our team in chennai Tamil Nxc4x81du IN-TN India IN ...

  • Solutions Architect

    4 hours ago

    Chennai, Tamil Nadu, India Optimum Solutions Pte Ltd Full time

    15+ years of experience with application developments, 7+ years of experience in solutioning & Architecture7+ Years Having strong knowledge in banking technology domain with at least 5+ years of experience in solutioning banking applications.Expert knowledge of multi cloud Azure, AWS & Google Experience of migrating and deploying cloud-based solutions...

  • Data Architect

    1 day ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Architect We are seeking a highly skilled and experienced Data Architect to lead the design, development, and implementation of our data infrastructure. The successful candidate will be responsible for architecting and implementing scalable, secure, and high-performance data solutions that meet the needs of our...

  • Solutions Architect

    3 days ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Greetings from TCS.TCS is Hiring For Solutions Architect - DataExperience : 10+ yearsRelevant Experience: 10+ yearsWORK Location: PAN IndiaJob Purpose and primary objectives:Key responsibilitiesDesign and manage ETL pipelines on cloud platforms (preference for AWS)Utilize tools like Airflow to orchestrate tasks and Cloud Watch to manage...

  • Big Data Engineering Lead- C13

    2 weeks ago

    Chennai, Tamil Nadu, India Citigroup Full time

    The Senior Big Data engineering lead will play a pivotal role in designing implementing and optimizing large-scale data processing and analytics solutions This role requires a visionary leader who can drive innovation define architecture strategy and ensure the scalability and efficiency of our big data infrastructure Key Responsibilities Lead the...

  • Senior Big Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description\As a seasoned professional in the field of data engineering, you will play a pivotal role in designing and implementing cutting-edge data solutions that drive business growth and innovation. \Key responsibilities include architecting and defining data flows for big data/data lake use cases, with excellent knowledge on implementing full life...

  • Big Data Developer

    1 day ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • GCP Data Architect

    4 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Role: GCP Data ArchitectJob Location: Chennai/Hyderabad/Pune/Bangalore/GurgaonExp Range: 10Years to 15Years.Desired Competencies (Technical/Behavioral Competency):- Should have experience in GCP Data Architect- Should have experience in Data Flow, Data Proc, Big Query- Develop ETL/ELT pipeline using Data Flow, Data Proc, Big Query- Provide technical...

  • Big Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India beBeeBigDataEngineer Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop.Responsibilities:• Design, develop, and deploy big data solutions using Hadoop, Spark, and Scala.•...