Job Description

Real-time Data Architect

We are seeking a highly experienced Real-time Data Architect to join our team. The ideal candidate will have robust experience in designing and implementing data driven solutions for Oil and Gas clients, with a strong background in system integration, solution architecture, cloud computing, and business analytics. The candidate should have a demonstrated proficiency as well as rich experience in production operation & emissions processes across Upstream segment of the Oil industry. Additionally, the candidate should possess expertise in communicating and collaborating across organizational levels and with cross-functional teams to achieve a common goal.

Key Responsibilities:

• Design and implement data architectures that support scalable real-time production, field operations, emission, and alarm management in the Oil & Gas industry.
• Work with IT and business teams to identify, evaluate, recommend, design, and develop integrated solutions that meet those needs.
• Review and evaluate the exiting real-time systems landscape and identify architecture remediation opportunities for highly scalable platform.
• Build an interim and target architectures for the platform, implementing industry best practices and latest technologies such as IICS, Kafka, IoT Hub, Ignition etc.
• Consolidate requirements from various groups (working on emissions) and design a core, scalable and common data architecture/solution. This includes data model that can link to company master and transactional data.
• Partner closely with product managers and business analysts to align product architecture with business needs.
• Partner with Data Architecture, emerging technologies and data engineering teams to enable data integration patterns to democratize real-time data for analytics developments (Machine learning, Visualization, Data analysis).
• Work closely with Enterprise Data Architects to enforce the global standard and best practice.
• Perform key design decisions review to ensure relevant technical strategies, policies, standards, and practices are applied correctly across products and services.
• Develop and maintain data models for real-time production operations and emissions data sets.
• Ensure data integrity and consistency across all data sets.
• Monitor and optimize data architectures for performance and scalability.

Technical Skills:

• Strong experience working with SCADA, IoT devices, Data Historians, Big Data environments – Hadoop (Apache, Cloudera), Cloud (Azure, Amazon, GCP) and messaging protocols – MQTT, MODBUS, AMQP, RPC
• Strong experience in managing data and workflows for Real-time & high frequency systems
• Strong proficiency in Cloud computing, Microsoft Azure – Databricks, Azure IoT, Kafka and Scada systems.
• Experience developing solutions in Snowflake and related technologies like IICS, Snowpipe, DBT, or ADF
• Strong proficiency in Python, R, SQL, C++, PowerShell.
• Experience in Business Intelligence, Power BI, Spotfire,
• Experience with data modeling and database design
• Familiarity with data warehousing and business intelligence concepts
• Strong problem-solving skills and ability to work in an agile fast-paced environment.
• Strong communication and collaboration skills

Required Skills: Top must-have technologies/requirements: • Managing data and workflows for real time and high frequency systems • Cloud computing with Azure data services (databricks, IoT, etc) • Scripting – anything from Python, R, SQL, C++, PowerShell.

Job Tags

Similar Jobs