Post New Job
Back to all Jobs see more IT Software Services jobs

Sr. Data engineer

  • Full time
  • View on Map
  • @GiftAbled posted 4 months ago
  • Posted : July 21, 2023 -Accepting applications
  • View(s) 103

Job Detail

  • Job ID 50466

  • D&I Classifications

  • D&I Classifications Any
  • PwDs All

  • Job Specifics

  • Experience 10 Years +
  • Gender Any
  • Qualifications Post Graduate

Job Description

    • exposure to other cloud solutions (Google, AWS) a plus.
    • Proven track record in designing, developing and implementing data modelling, at a conceptual, logical and physical level.
    • Experience with accountability for E2E Data Architecture and Lifecycle (including non-functional requirements and operations) management.
    • Understands industry recognised data modelling patterns and standards
    • Understands overall IT system design, in particular networking, authorization and authentication protocols, data security, disaster recovery.
    • Knowledge of the latest technologies to process large amount of data (Apache Spark; Databricks is a plus)
    • Experience in MDM, Metadata Management, Data Quality and Data Lineage tools.
    • Expertise in cloud security and identity best practices
    • A deep understanding of ETL and ELT tools and techniques
  • Strong experience in architecting ‘fit-for-purpose’ and ‘fit-for-use’ complex solutions on the Microsoft Azure cloud stack [IaaS, PaaS and SaaS] 
  • Very strong hands-on experience in using Microsoft Azure services like Azure Data Factory, Data brick services (like processing streaming data using Spark clusters), usage of Blob containers, ESB, Event Grid, Azure SQL server, Cosmos DB, Azure functions, Analytics (like Power BI) is a mandatory requirement.
  • Excellent understanding of architecture patterns and best practices with proven innovative and leading-edge thinking to build cloud-ready systems (e.g., Domain Driven Architecture, multi-tenancy, building for resilience, scalability, performance, and federation, microservices etc.) 
  • Hands-on work experience on application platforms like .Net, Python, Java etc. preferred 
  • Understanding of big data platforms concepts and NoSQL technologies, and ability to map such
  • The candidate should have experience in modeling data for traditional structured data, as well as information design in Data Lake and NoSQL database engines. 
  •  Fluent with modelling, development and project execution processes around star, snowflake, 3NF, and Data Vault approaches. 
  • Good experience in working with data using SQLs, Python and Scala in Microsoft based resources like Azure Synapse and Data Lake. 
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. 

Required skills

Azure Data bricks Azure Data factory v2 Azure Data Lake Gen1/Gen2 Azure DWH Azure Synapse

Related Jobs

 
Required 'Candidate' login to applying this job. Click here to logout And try again
 
 
 

Apply for this Job

  • D&I Classifications

  • Upload Files

    You can upload up to 2 files.

  • Education

  • Skills

  • Previous Job History

  • Drop a resume file or click to upload.
    To upload file size is (Max 10Mb) and allowed file types are (.doc, .docx, .pdf)
    or
    Upload Resume
  • Upload Cover Letter

    To upload file size is (Max 1Mb) and allowed file types are (.doc, .docx, .pdf)

 

Answers

 

Account Activation

Before you can login, you must activate your account with the code sent to your email address. If you did not receive this email, please check your junk/spam folder. Click here to resend the activation email. If you entered an incorrect email address, you will need to re-register with the correct email address.