Databricks Engineer Jobs

We are seeking a seasoned engineer to spearhead the conception and execution of a comprehensive end-to-end solution within our Team. In this role, you will hold overall responsibility for crafting the System Design Specification (SDS) and driving its technical realization.

Responsibilities:

• Champion the delivery of both effective and efficient solutions by adhering to milestones, punctuality, budgetary parameters, and compliance with corporate quality and security benchmarks.
• Synthesize business insights, Enterprise Architecture inputs, system performance requisites, and development standards into detailed functional, technical, and user-centric designs for applications and systems.
• Provide consultation during the development of the System Requirements Specification (SRS).
• Engineer superior functional, technical, and user-centric designs.
• Innovate solution alternatives, rallying support from stakeholders.
• Innovate strategies to curtail expenses, contributing to the implementation of strategic solutions that enhance cost efficiency and elevate stakeholder engagement.
• Collaborate with technology partners and peers to define metrics and performance objectives.
• Tackle any issues that may impinge on application integrity, spanning across capabilities and releases.
• Collaborate with invested parties to produce well-informed project estimates.
• Formulate and meticulously document an intricate solution blueprint within the SDS framework, infusing your profound subject matter expertise across the Azure Cloud lifecycle.
• Contribute to knowledge management practices, ensuring the meticulous codification, tracking, and oversight of critical knowledge.
• Closely scrutinize technical deliverables for unwavering quality throughout the detailed design and development phases, swiftly identifying gaps and recommending redesigns when necessary.
• Harness existing reusable components in design, interlinking them with business requisites, while designing new modules with reusability as a guiding principle.
• Engage in the development and programming of intricate applications and systems, embracing complexity.
• Demonstrate fidelity to the clients technology delivery protocols, project management methodologies, business technology architecture, risk evaluation, and production capacities. This encompasses meticulous project documentation, comprehensive scope estimates, and judicious cost considerations.
• Adept at constructing and designing Azure Databricks.

Qualifications:

Essential:

• Profound familiarity with Pyspark, Kafka, and data engineering frameworks.
• Proficiency in Databricks and Azure, encompassing Data Factory, IaaS VMs, Data Lake Storage, and Kubernetes.
• Possession of an Undergraduate Degree or Technical Certificate.

Preferred:

• A Graduate degree would be advantageous.
• Accumulated experience of 7+ years in full-stack development.
• Mastery over the business landscape, the broader organizational dynamics, the technical ecosystem, standards, processes, tools, methodologies, various programming languages, operating systems, and solutions design from a comprehensive design/support/solutions perspective.
• A history of 3 years engaging with salt scripting and performance benchmarking.