US20150339948A1 - Interactive Systems for Providing Work Details for a User in Oil and Gas Operations - Google Patents

Interactive Systems for Providing Work Details for a User in Oil and Gas Operations Download PDF

Info

Publication number
US20150339948A1
US20150339948A1 US14/719,482 US201514719482A US2015339948A1 US 20150339948 A1 US20150339948 A1 US 20150339948A1 US 201514719482 A US201514719482 A US 201514719482A US 2015339948 A1 US2015339948 A1 US 2015339948A1
Authority
US
United States
Prior art keywords
industrial
asset
operable
industrial equipment
operator
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/719,482
Inventor
Thomas James Wood
Alan Roachell
David Truax
Tom Wood
Mike Rowan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
3rd-Eye Technologies Inc
Original Assignee
3rd-Eye Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 3rd-Eye Technologies Inc filed Critical 3rd-Eye Technologies Inc
Priority to US14/719,482 priority Critical patent/US20150339948A1/en
Assigned to XTREME DRILLING AND COIL SERVICES reassignment XTREME DRILLING AND COIL SERVICES ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ROWAN, MIKE, WOOD, THOMAS JAMES, ROACHELL, ALAN, WOOD, TOM, TRUAX, DAVID
Assigned to WOOD, THOMAS JAMES, ROWAN, MIKE reassignment WOOD, THOMAS JAMES ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: XTREME DRILLING AND COIL SERVICES
Assigned to 3RD-EYE TECHNOLOGIES, INC. reassignment 3RD-EYE TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ROWAN, MIKE, WOOD, THOMAS JAMES
Publication of US20150339948A1 publication Critical patent/US20150339948A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/30Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/02Knowledge representation; Symbolic representation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/07Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements using light-conductive means, e.g. optical fibres
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/02Surgical instruments, devices or methods, e.g. tourniquets for holding wounds open; Tractors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/34Trocars; Puncturing needles
    • A61B17/3417Details of tips or shafts, e.g. grooves, expandable, bendable; Multiple coaxial sliding cannulas, e.g. for dilating
    • A61B17/3421Cannulas
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B1/00Optical elements characterised by the material of which they are made; Optical coatings for optical elements
    • G02B1/04Optical elements characterised by the material of which they are made; Optical coatings for optical elements made of organic materials, e.g. plastics
    • G02B1/045Light guides
    • G02B1/048Light guides characterised by the cladding material
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/0001Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • G09B19/003Repetitive work cycles; Sequence of movements
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163Optical arrangements
    • A61B1/00165Optical arrangements with light-conductive means, e.g. fibre optics
    • A61B1/0017Details of single optical fibres, e.g. material or cladding
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B2017/00831Material properties
    • A61B2017/00902Material properties transparent or translucent
    • A61B2017/00907Material properties transparent or translucent for light
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/34Trocars; Puncturing needles
    • A61B17/3417Details of tips or shafts, e.g. grooves, expandable, bendable; Multiple coaxial sliding cannulas, e.g. for dilating
    • A61B17/3421Cannulas
    • A61B2017/3445Cannulas used as instrument channel for multiple instruments
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/30Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
    • A61B2090/306Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure using optical fibres
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/30Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
    • A61B2090/309Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure using white LEDs
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2217/00General characteristics of surgical instruments
    • A61B2217/002Auxiliary appliance
    • A61B2217/005Auxiliary appliance with suction drainage system

Definitions

  • the present invention relates generally to knowledge-based systems, and more specifically to an industrial knowledge system and method that provides improved asset maintenance and operation.
  • Job function competency may not be suitable, or could be suitable with additional assistance for a particular asset, this information may not be readily available to supervisors.
  • Job function competency may not be specifically tied to the existing assets and regulations. Regulator and industry standards, which must be met, may be difficult to locate for an asset or piece of equipment and/or may not be readily available in a practical useable form for the operator that is tasked with the asset or equipment utilization.
  • maintenance systems may not have information such as the current location of an asset or piece of equipment, the current condition, or the last person to interact with the asset.
  • Maintenance scheduling is often based on calendar dates rather than asset condition, location and degree of utilization.
  • job function knowledge transfer is conducted largely by the following methods: use of peers or a mentor, classroom settings, and manuals. While of benefit, these techniques fall short of providing that an operator is prepared for the desired maintenance or job performance.
  • a peer or mentor may show a new hire the job functions of the position by use of a shadowing method of following the peer or mentor around observing the job function first hand.
  • the issues with this methodology may include, but are not limited to: the peer or mentor may not know the correct or safest procedures, the peer or mentor may not be properly trained or experienced, and the peer or mentor may not have the proper patience to conduct the knowledge transfer.
  • Some mentors or peers may not have adequate time to demonstrate the process step-by-step, and may have trouble clearly communicating the objectives of the knowledge transfer. Further, the mentor must devote considerable time to a very limited number or trainees.
  • Knowledge transfer by class room setting is another method used for specific components of job functions.
  • This methodology uses a group setting within a classroom to discuss and review processes and procedures of the job function.
  • Classroom training is normally scheduled when sufficient numbers of students are available for training, not when the training is required by the individual student.
  • classroom-based training is typically not able to reproduce the work environment that is required by the job function. Accordingly, this methodology necessitates a high degree of organization, considerable downtime of trainees, and higher costs.
  • training events are not easily scheduled prior or during a job function to confirm understanding or competency of the asset or job function. Records of such training events, when available, are often not updated immediately.
  • the process of identifying, documenting, logging, tracking, scheduling, training for and conducting a job function may typically include the following steps which normally must be performed in a linear way because each step depends on the previous step being completed: (1) documenting the job task and identifying the job functional requirements, (2) documenting and logging the equipment and asset maintenance requirements and maintenance interval schedules, and (3) documenting and logging the location and status of the equipment and assets.
  • steps may include (4) conferring with regulatory requirements, industry standards or company policies, (5) developing “How To” information and job procedures, (6) updating or modifying job function competencies, (7) developing training segments or courses as defined by the job task requirements, (8) selecting a mentor or organizing a training course, (9) logging training taken and training required, and (10) scheduling refresher training as required by the job function.
  • an object of the present invention is to provide a workforce that is more efficiently trained to service a plurality of different types of assets located at a plurality of locations.
  • Another object of the present invention is to provide improved maintenance of a plurality of different types of assets located at a plurality of locations.
  • Another object of the present invention is a system that operates with different types of display devices at a plurality of locations.
  • the present invention provides a system to guide industrial maintenance of industrial equipment assets for a user in oil and gas operations.
  • the invention comprises at least one computer for implementing an industrial knowledge system.
  • the industrial knowledge system may comprise a plurality of how-to segments to perform job procedures for maintaining a plurality of industrial equipment assets.
  • the industrial knowledge system is operable for delivering how-to segments for viewing by users for a selected job procedure for maintaining a selected industrial equipment asset on a selectable display device at a plurality of locations.
  • the how-to segments comprise step-by-step instructions including photos, videos, and/or selectable documentation.
  • a maintenance tracking and scheduling system for the industrial knowledge system comprises maintenance schedules and asset maintenance status for the selected industrial equipment asset.
  • a regulations and standards system for the industrial knowledge system comprises regulations and standards for the selected industrial equipment asset.
  • the how-to segments incorporate respective of the regulations and standards.
  • An asset tracking system for the industrial knowledge system may comprise location information for the selected industrial equipment asset and/or location information of competent operators for servicing the asset.
  • the system may further comprise a training delivery and records system.
  • the industrial knowledge system is operable for delivering the maintenance and schedules, regulations and standards, training, and location information for the selected industrial equipment asset for viewing by the user on a selectable display device at the plurality of locations.
  • the system may further comprise a job function competency system for the industrial knowledge system with industry or company defined requirements for the job function for the selected industrial equipment asset.
  • the how-to segments and the training incorporate industry or company defined requirements.
  • the job function competency system is operable for rating the competency of the user for a selected job function.
  • an industrial knowledge system may comprise a job task module with a plurality of job tasks to be performed on a plurality of the industrial equipment assets by the operators.
  • a maintenance module may comprise required tooling for each job task for each of the plurality of industrial equipment assets to be utilized by the operators.
  • An asset location module may comprise respective locations of the plurality of industrial equipment assets.
  • a low power near field transmitter/receiver is preferably associated with each of the plurality of industrial equipment assets for a precise location of a selected industrial equipment asset and/or status information of the asset.
  • the transmitter/receiver can be operable for transmitting/receiving electromagnetic waves.
  • An accounting module is operable for producing a purchase order for maintenance of the selected industrial equipment asset and a teaching module may comprise how-to information linked to the accounting module.
  • An intrinsically safe heads up display may be worn by the operator to guide by display industrial maintenance on the industrial equipment asset.
  • the HUD is operable to receive information from the low energy near field communicator, which may comprise location, identification, and status of the industrial equipment asset.
  • the system may further comprise a hard hat with an intrinsically safe compartment wherein an extended life battery pack for use with the HUD is mounted in the intrinsically safe compartment.
  • System software is operable for communication with a plurality of display devices which may comprise laptops, tablets, cell phones, and computer workstations at a plurality of different locations.
  • the system software is operable for utilizing display devices including the HUD for training on demand of the operator at a selected location of the industrial equipment asset.
  • the system software is configured to determine and store information of a competency level for the operator of the industrial equipment asset based on the training and records of experience.
  • the system software is in interactive communication with the operator through the HUD to provide instructions for maintenance of the selected industrial equipment asset.
  • the system software is selectively operable for providing that the instructions are adjusted to a competency level of the operator.
  • the instructions to the operator may comprise step-by-step work details with photos, videos, and detailed documentation.
  • the system software can be operable for sending photos or videos that superimpose components on a screen of the HUD to guide the operator in maintaining the industrial equipment asset.
  • the HUD is operable to receive information from the low energy near field communicator which may comprise location, identification, and status of the industrial equipment asset.
  • the system software is in interactive communication with the operator through the HUD and/or other display devices to provide instructions for maintenance of the selected industrial equipment asset.
  • system software is selectively operable for providing that the instructions are adjusted to a competency level of the operator.
  • the system software is operable for sending a superimposed indicator representative of an underlying component of the industrial equipment asset for display by the HUD.
  • the superimposed indictor can be aligned with the underlying asset component requiring servicing when viewed by the operator.
  • the superimposed indicator may change after the underlying asset component is serviced thereby allowing easier tracking of completion of a plurality of serviced components on the industrial equipment asset.
  • system is programmed for sending how-to information for the selected industrial equipment asset upon the production of the purchase order.
  • the system may further comprise a job function competency module operable to determine which operator or operators from a plurality of operators are competent to service a selected industrial equipment asset and/or which operators are in a definable vicinity of said selected industrial equipment asset.
  • the job function competency module cooperates with the teaching module to adjust the how-to information based on a competency level of a selected operator.
  • the system software is in interactive communication with the operator through the HUD to provide instructions for maintenance of the selected industrial equipment asset.
  • the system software is selectively operable for providing that the instructions are adjusted to a competency level of the operator.
  • FIG. 1 is a schematic illustrating systems or modules that are interconnected with the information in each system or module to provide an industrial knowledge system readily available for use as needed in accord with one possible embodiment of the invention.
  • FIG. 2 is a schematic wherein an industrial knowledge system is interactively connected to equipment and personnel through any number of computer devices at widely dispersed locations in accord with one possible embodiment of the invention.
  • FIG. 3 is a flow diagram showing steps in development of the knowledge available in an industrial knowledge system in accord with one possible embodiment of the invention.
  • FIG. 4 is a flow diagram showing an application of the industrial knowledge system for use in pre-job task evaluation, pre-job training, and on the job applications with a wide range of information for particular assets in accord with one possible embodiment of the invention.
  • FIG. 5 is a flow diagram showing interaction steps between an operator and an industrial knowledge system in accord with one possible embodiment of the invention.
  • FIG. 6A shows an HUD (heads up display) device that may be used by operators during operation or training in accord with one possible embodiment of the invention.
  • HUD heads up display
  • FIG. 6B shows an intrinsically safe hard hat with a locally available extended life battery pack for use with the HUD of FIG. 6A in accord with one possible embodiment of the invention.
  • FIG. 7A illustrates an asset or type of equipment to maintain in accord with one possible embodiment of the invention.
  • FIG. 7B illustrates an HUD (heads up display) image of the asset and components to service in accord with one possible embodiment of the invention.
  • FIG. 7C illustrates a superimposed picture of an HUD image with the components to service in accord with one possible embodiment of the invention.
  • FIG. 7D illustrates an HUD image with the components to be serviced where the HUD image of the components change as they are serviced in accord with one possible embodiment of the invention.
  • FIG. 8 illustrates a top level flowchart of interaction between an industrial knowledge system and an operator in accord with one possible embodiment of the invention.
  • FIG. 9 illustrates a flowchart of interaction between an industrial knowledge system and an operator during a work operation in accord with one possible embodiment of the invention.
  • FIG. 10 illustrates a flowchart of interaction between an industrial knowledge system and an operator with respect to various notifications that may be received in accord with one possible embodiment of the invention.
  • FIG. 11 illustrates a flowchart of interaction between an industrial knowledge system, an operator, and Bluetooth low energy (BLE) signals and/or other sensors with respect to various contextual situations that may arise in accord with one possible embodiment of the invention.
  • BLE Bluetooth low energy
  • Industrial knowledge system 10 comprises interconnected modules or systems that may generally be referred to as maintenance system 12 , equipment and asset tracking system 14 , regulations, standards, and policies system 16 , “How To” information and job procedures system 18 , job function competency system 20 and training delivery and records system 22 .
  • industrial knowledge system 10 and/or components thereof may also be referred to as system software.
  • each of the systems or modules are linked together so that industrial knowledge system 10 is able to provide and receive information useful for more efficiently utilizing training and asset information to maintain the assets as well as continually updating the information in industrial knowledge system 10 .
  • the modules or systems are representative and could be described differently or be organized differently and/or could be further differentiated by function.
  • Maintenance system 12 is utilized to keep track of maintenance schedules, equipment history, provide predictive maintenance, manage inventory, and keep track of costs, accounting and the like.
  • Various software packages may be utilized for this purpose, see e.g. TabwareTM.
  • the maintenance preferably keeps track of the equipment status such as whether the equipment is in service, out of service, needs maintenance, needs replacement and the like.
  • Equipment and asset tracking module 14 may be utilized to keep track of the location of equipment whether moveable or fixed.
  • assets may be fitted with RFID or Bluetooth transmitter and/or receivers such as Bluetooth Low Energy (BLE) devices that provide precise location information that can lead an operator to a precise location.
  • BLE Bluetooth Low Energy
  • Bluetooth communicators provide the possibility of different signals being sent as compared with RFIDs, which transmit only predetermined information. Unlike RFIDs, Bluetooth communicators can originate the signal rather than respond to the signal.
  • RFIDs have a very limited transmitter range, usually considerably less than 20 meters. Lowe Energy BLE devices can send longer range signals up to 100 meters, 200 meters, or 300 meters to provide a beacon that leads a user to the very precise location of the equipment asset. GPS or written records may be associated with the equipment to provide general location information.
  • the transmitter and/or receiver devices may include detailed information about the type of asset, asset maintenance history, status of the asset, special instructions or warnings about the asset, and the like. Where applicable, location of operators and the ability to select vicinity ranges of operators is available based on display devices with GPS functions utilized by the operators.
  • Module 14 may also be referred to herein as an asset tracking module or system, or the like.
  • Regulations, Standards, and Policies module 16 may comprise a collection of up to date information for equipment and assets such as API (American Petroleum Institute) requirements and OSHA requirements. Module 16 may also be referred herein to as a regulations module, or the like and can include specific company regulation, rules and procedures.
  • Module 18 comprises “how to” information and job procedures and may be referred to herein as a teaching module, industrial knowledge system, knowledge based job system and the like, which has access to information from all modules.
  • knowledge system 10 communicates through knowledge based job system 18 as described in FIG. 2 .
  • the invention is not limited to communication through any particular system or module.
  • the accumulation of information in knowledge base job system 18 is described in the flowchart of FIG. 4 and the application of the knowledge is shown in the flowchart of FIG. 5 , discussed hereinafter.
  • Operator interaction with knowledge based job system 18 is shown in the flowchart of FIG. 6 .
  • Specific designation of a particular module, such as knowledge base job system 18 for communications is a preferred but non-limiting embodiment. Accordingly as used herein, the industrial knowledge system 10 effectively communicates with operators and assets as described hereinafter.
  • Job function competency system or module 20 can be based on work instruction details segmented by industry standard activity coding.
  • the present invention may utilize IADC (International Association of Drilling Contractors) drilling activity codes.
  • IADC International Association of Drilling Contractors
  • work instruction details are used to provide concise segments covering specific operational details using a methodology that includes: step-by-step instruction of procedures, pictures, videos and links to industry regulations. This information may be utilized by knowledge based job system 18 as described before and discussed again in relationship to flow charts and the like. It will be appreciated that depending on the industry, standards for job competency may be industry standards and/or otherwise developed.
  • System or module 22 can provide training delivery and records of training.
  • the wide range of training delivery is discussed hereinafter but includes pre-job training, on the job training, refresher training, step by step automated assistance, and virtual help by mentors delivered virtually anywhere.
  • the records of job training provide that system 10 knows the competency level of the operator as compared to the job function to ensure that the operator is capable of performing the job function.
  • system 10 can further promote success by allowing fine tuning of job activities to the competency level of the operators, e.g., by adding instruction in areas that the operator may be less familiar.
  • the knowledge system 10 is a system comprising an encompassing source of information containing all relevant work instruction details for oil & gas operations such as drilling and services.
  • the present invention is especially useful for industrial applications with oil and gas being an example given herein.
  • company work instruction details are segmented by industry standard activity coding, known as IADC (International Association of Drilling Contractors) drilling activity codes. These work instruction details are used to provide concise segments covering specific operational details using a methodology that includes: step-by-step instructions of procedures, pictures, videos and links to industry regulations.
  • each of modules 12 , 14 , 16 , 18 , 20 and 22 are linked and viewable from a laptop computer, touch screen monitor computer, tablet computer, smartphone/PDA and/or HUD glasses. There may be any number of devices such as this and these devices may be located at a wide number of different locations.
  • the present invention can directed to the Oil & Gas Industry, the drilling segment of the Oil & Gas Industry, the refinery segment of the Oil and Gas Industry, and/or to rig operations of the drilling segment of the Oil & Gas Industry.
  • the work instruction details are termed “How To Guides” and include detailed description of the active subject work, required tools or tooling, any specific knowledge or know-how, all precautions, cautions and warning related to the specific job task.
  • the “How To Guides” are used to provide clear role responsibility for all involved personnel.
  • FIG. 2 there is shown industrial knowledge system 10 delivering information to and receiving information from numerous locations in system 200 .
  • knowledge system 10 may communicate through specific modules or systems discussed therein with respect to FIG. 1 , such as module 18 , which involves a training module linked with other modules described hereinbefore.
  • training can be supplied on many different types of devices at virtually any time and in many different formats including written, video, pictures, communications with mentors, and/or combinations of these.
  • the training materials can be delivered over wide spread locations.
  • System 200 is interactive with these devices and accumulates job competency information for operators. Other information such as operator location information and the like may be received by knowledge system 10 , which may be used for dispatching competent operators within a desired vicinity of equipment to be serviced.
  • integrated knowledge system 10 may be utilized to supply and receive information from components of an LMS (learning management system) server 210 .
  • Learning management systems are utilized in various corporate environments and are excellent for many purposes, but do not in and of themselves provide the knowledge that must be taught.
  • Integrated knowledge system 10 provides the necessary content.
  • LMS server 210 may be utilized for various purposes, such as, but not limited to creation of class rosters, control over registration processes, and the ability to create waiting lists. Other functions may include uploading and management of documents containing curricular content, delivery of course content over web-based interfaces, most often allowing remote participation by the instructor or pupil.
  • LMS server 210 may be used for creation and publication of course calendars, interaction between students, such as instant messaging, email, and discussion forums, methods of assessment and testing (like creating pop quizzes).
  • LMS systems used in corporate training environments often have additional features that satisfy goals relating to knowledge management and performance evaluation, such as: automatic enrollment and reminders for mandatory courses, options for manager access, such as to approve materials or participation, integration with human resource systems for tracking employment eligibility, performance goals, and similar corporate priorities, and control over access and class groupings according to a number of metrics, such as geography, involvement in a particular project, or levels of security clearance.
  • Logging into system 210 by users such as user 212 may be accomplished by password, RFID, Bluetooth or the like.
  • the devices may comprise RFID readers such as RFID reader 216 utilized with cell phone 206 .
  • RFID readers for devices or other types of sensors such as biometric sensors or the like may be conveniently used for logging into the system.
  • passwords or other types of recognition devices may be utilized.
  • System 200 can deliver on the job information to operators 218 over PDA (personal digital assistant) 220 or HUD (heads up display) glasses 600 .
  • HUD glasses 600 may automatically detect operators using RFID devices carried by operators.
  • HUD 600 can detect equipment, such as equipment or asset 226 by Bluetooth and/or RFID 612 .
  • Assets such as asset 226 may be connected to data server 228 to provide location data, maintenance requirements, status and the like, which is stored and utilized by industrial knowledge system 10 . However, if assets are not connected through servers to system 10 , the status of assets can also be provided to industrial knowledge system 10 by operators through HUD 600 or other devices that connect to system 10 .
  • Bluetooth transponders such as Bluetooth Low Energy (BLE) devices 230 may be used to provide very precise location information for moveable equipment 226 .
  • GPS devices 232 may be used with moveable equipment to provide general location information.
  • BLE device 230 is not limited to line-of-sight transmission. Fixed or less moveable equipment may also be monitored by similar sensors or at least listed with location information.
  • Device 230 may be referred to herein as a low power transmitter, low energy transmitter, low energy near field communicator, or the like.
  • BLE devices 230 may interact with HUD devices 600 or other display devices to lead operators such as operator 218 to precise locations, provide equipment status and identification information, and the like.
  • the precise location is more than general location information provided by GPS devices, or written records because the operator is led to the BLE device carried by operator 218 by physically searching for it. This may be necessary and highly desirable in some locations.
  • BLE device 230 is preferably limited in transmission to up to 100 meters, 200 meters, or three hundred meter ranges depending transmitter design and the overall metal clutter of the location.
  • RFID is a transponder to an audio signal, unlike Bluetooth which provides two-way electrical wave communication, and does not provide precise location information more than 10 or 20 meters away and may have a range considerably less than that. Accordingly, RFID is less useful for locating equipment 226 on a cluttered or storage location.
  • FIG. 3 there is shown flowchart 300 , which relates to the systems or modules discussed in FIG. 1 .
  • Flowchart 300 describes development of knowledge content for integrated information system 10 .
  • the accumulated knowledge could be implemented through system or module 18 from FIG. 1 that provides “how to” information and job procedures, which is linked to the other modules of FIG. 1 .
  • the present invention provides an integrated approach to knowledge documentation, knowledge transfer and event scheduling, tracking and logging. With the industrial knowledge system 10 procedures can be concurrently developed, tracked and logged into the linked systems.
  • linked arrow bus 336 indicates an information flow whereby developers of any particular step or module, as discussed below, can utilize information from any other module. This is not possible in the prior art as discussed hereinbefore.
  • the present invention documents job function requirements required for job function competency.
  • job function requirements can be based on work instruction details segmented by industry standard activity coding for performing work on each asset.
  • the present invention utilizes IADC (International Association of Drilling Contractors) drilling activity codes to provide job function requirements. Job function requirements are evaluated and documented within integrated knowledge system 10 .
  • the job function requirements can be accessed and/or have input directly from regulatory requirements, industry standards, and company policies at step 318 ; available assets and equipment, including locations and maintenance status, from steps 312 , 314 , and 316 ; “know-how” and required knowledge from step 320 ; “how-to” information and job procedures from step 322 ; and required training and current training status from at least one of steps 326 and 328 .
  • determining a job function requirement may comprise a series of steps for performing a job task, e.g., changing oil: (1) asset updates (different type of oil required due to new piston rings; predetermined time intervals to change oil), (2) tooling (branched container for oil), (3) locating asset (current location), (4) maintenance requirements (changing oil based on asset's time in operation rather than at fixed time intervals), (5) compliance with regulatory requirements (disposal requirements which change over time).
  • asset updates different type of oil required due to new piston rings; predetermined time intervals to change oil
  • tooling branched container for oil
  • locating asset current location
  • maintenance requirements changing oil based on asset's time in operation rather than at fixed time intervals
  • compliance with regulatory requirements disosal requirements which change over time).
  • a job task is a job to be performed, e.g., changing the oil of an asset.
  • the job tasks involve specific tasks to be used with equipment or assets to be maintained, operational functions, and the like.
  • job tasks may also be defined within a company or industry as the tasks that need to be completed for specific jobs.
  • Steps 312 through 318 can be performed in any sequence including being simultaneously performed.
  • step 328 may be repeatedly performed over time as refined information becomes available concerning the effectiveness of the training segments with respect to successful task completion.
  • the related modules are readily available to be updated as desired.
  • Step 312 documents the required equipment, the assets to be worked with, and the types of tools needed to perform any particular job task. Accordingly, each operator will have a check list of tools needed, which makes job success and completion more likely to be efficiently and quickly accomplished.
  • Step 314 provides that the availability and location of the tools and assets be provided within integrated knowledge system 10 . In this way, the logistics of these items are available for use by operators in conjunction with step 316 , which sets forth the maintenance requirements. This type of complete information available from industrial knowledge system 10 provides significant time savings in coordinating schedules and plans.
  • Step 318 provides that the existing regulatory requirements, industry standards, and company policies for the job tasks is readily available.
  • this information may comprise API (American Petroleum Institute) requirements and OSHA requirements, which are up to date and preferably include index search capability.
  • Step 320 takes the information of 310 to 318 , and any other relevant information, and documents the required knowledge and/or know-how required to complete the job tasks that have been listed.
  • Required Knowledge and Know-How 320 provides an understanding of job procedures and the reasons behind the job procedures.
  • step 322 experts may be utilized to document the how-to information or how-to segments of information for performing the job tasks. This may include listing or developing procedures that have been known to be effective in successfully completing the job tasks. Job procedures are more detailed instructions required to complete the generic steps in the job function requirements, e.g., for changing the oil this may comprise switching to back up motor, shut down motor, and let cool down. How-to segments of information provide training in video/words/voice for the required knowledge and know-how with each detail of the job procedures being explained.
  • Job function competency 324 can be training requirements that document the user has acquired the required knowledge which indicates a competency level to perform the job task. A time-stamp may be utilized to document this. This can be readily changed over time as desired to more accurately reflect the desired level of training.
  • step 326 For implementation of step 326 , it will be appreciated that considerable information is now readily available to develop training segments or courses that can be used to teach operators how to successfully complete the job tasks because the requirements are known. Training segment instruction details are used to provide concise segments covering specific operational details using a methodology that includes: Step-by-step instructions of procedures, pictures, videos and links to industry regulations. This information may be utilized by knowledge based job system 18 as described before and discussed again in relationship to flow charts and the like. It will be appreciated that depending on the industry, standards for job competency may be industry standards and/or otherwise developed.
  • Step 328 reviews the training segments or courses as required by job task. As discussed above, step 328 may be repeatedly performed as information becomes available concerning the effectiveness of the training segments with respect to successful task completion.
  • portals for knowledge transfer are developed. These portals are used to provide training segments and courses as needed. For example, as shown in FIG. 2 , numerous portals may be utilized. The operators such as operator 212 may directly access the training segments and courses on an as desired basis whenever and wherever they may be utilizing a wide range of different types of delivery items prior to performing the job tasks or as refresher courses. Training systems may be utilized as discussed above with respect to LMS server 210 .
  • HUD glasses 600 may show components on the equipment to be serviced. Step-by-step instructions may be provided for each component. The components may be overlaid or indicated with indicators that could be selected for this purpose as shown in FIG. 7A-7D .
  • HUD glasses 600 may broadcast video from the operator on the job to more experienced personnel such as supervisors who can guide a less experienced local operator successfully through successful completion of the job task.
  • experienced personnel may be utilized to oversee numerous lesser experienced operators from remote locations.
  • the job function competency level of the less experienced operators may be at a level sufficient to believe that with additional help from the experienced operators that the job will be completed successfully.
  • post training segments or courses are available through the various portals. These segments can be used to further solidify the knowledge required for successful completion of job tasks.
  • the delivery can be made through numerous portals discussed above which can be implemented through the Internet, company Intranets, downloaded files stored on display devices, or the like.
  • the segments or courses can be delivered to different types of display devices such as HUD devices, laptop computers, touch screen monitor computers, tablet computers, smartphone/PDAs, and the like.
  • step 334 the training requirements, availability for training courses and schedules is provided.
  • the knowledge for industrial knowledge system 10 is developed. The development is typically ongoing, revised for new types of equipment, and remains an invaluable source of information developed and tested over time.
  • Maintenance tracking and scheduling system 12 equipment and asset tracking system 14 , regulation, standards and policies system 16 , “How To” information and job procedures system 18 , job function competencies system training delivery 20 , and tracking and records system 22 can be embedded or linked when using integrated knowledge system 10 and viewable from a laptop computer, touch screen monitor computer, tablet computer, smartphone/PDA and/or HUD glasses.
  • FIG. 4 provides flowchart 400 of the application or structure of industrial knowledge system 10 to specific job tasks, assets, and operators.
  • Step 402 provides for a pre-job task evaluation.
  • the job task function already defined above, can be reviewed, but has already been determined, and is available from industrial knowledge system 10 .
  • the required training to complete the job task is indicated at step 406 , which allows selection or location of a competent operator.
  • the equipment required to perform the job task can be obtained from knowledge system 10 .
  • the location of the equipment or tooling is also provided.
  • Knowledge system 10 can also provide the status or condition of the equipment or tooling that is necessary to service as indicated at 412 .
  • Industrial knowledge system 10 provides the information for the required pre-job training as indicated at 416 . As discussed above, online training is available utilizing many different types of devices and at widely dispersed locations as indicated at 418 . Knowledge system 10 provides documentation of completion of training, understanding of regulatory requirements, as indicated at 420 and 422 . Job function competency check information documentation for particular operations and operators is stored as indicated at 424 . Accordingly, the job function competency module 20 , and as discussed at 424 is operable to determine whether any particular operator from a plurality of operators has a competency level to service a selected industrial equipment asset.
  • job function competency module 20 may be programmed to provide a determination whether any particular operator has a competency level to service said selected industrial equipment asset with additional support for a selected industrial equipment asset utilizing a selective connection to a second operator with a display device such as a lap top, tablet, heads up display, or the like, for additional support for said selected industrial equipment asset.
  • the competency level for this may be close to but perhaps not yet at the preferred competency level based on education completed and/or time of service.
  • the second operator may be a supervisor at another location.
  • Industrial knowledge system 10 can be utilized as the task is being performed, as indicated at 426 . Thus, considerable help is always available to the operator not only before the job but as the job is actually performed.
  • proximity sensors can be utilized to locate the equipment of interest as discussed previously.
  • GPS may not be quite as accurate and may be limited to general location information especially for smaller equipment that may be more difficult to locate.
  • BLE Bluetooth low energy beacons or the like can be utilized to provide highly precise location information to the operator who is in the vicinity of the asset utilizing the general location information. These beacons may provide precise location information that is available over longer distances, e.g. 100 meters, than is available through RFID and are more accurate than GPS.
  • status information may include whether the equipment is functional or non-functional, whether maintenance is needed and whether the service life of the equipment or asset has come to an end.
  • step 450 industrial knowledge system 10 provides on the job content such as step by step instructions, which may be in the form of images, written instructions, and the like.
  • Superimposed indicators and/or other images that highlight and keep track of functions to be performed or items to be maintained may be sent via HUD devices as indicated by HUD device 600 discussed with respect to FIG. 2 and in more detail with respect to FIG. 6A and FIG. 7A-7D .
  • step 452 the industrial knowledge system 10 documents completion of courses and/or refresher training.
  • the system will also provide information about the successful completion of the job and provide for use that information for revision of the how-to segment instructions if deemed desirable.
  • step 454 industrial knowledge system 10 updates the database on the equipment or tooling, the asset or tooling status, and other information required for continued status of the assets, tools, and the operators.
  • the application of knowledge transfer based training is provided using direct access training modules.
  • the training lists required tooling and associated documentation.
  • the system provides use of index search capability and step-by-step work details featuring photos, videos detailed documentation. PDF printout capability is available to training “How to Guides” sent directly to the work site.
  • FIG. 5 shows flow chart 500 , which provides one possible embodiment of interaction between operators and industrial knowledge system 10 .
  • FIG. 5 is a basic diagram with many possible variations.
  • the operator initiates the connection, receives acknowledgment, initializes the application of the training and selects the type of device to receive knowledge in steps 502 , 504 , 506 , and 508 .
  • the mode is selected to set up the type of training that will be requested as indicated at 510 . If the job task mode is selected, then the user is directed to 512 . Depending on whether the user is a new hire, is seeking a new role, or looking for a refresher course, the user is directed to 514 , 524 , or 536 .
  • the user can log into the system in various ways, with RFID tags or passwords being the most commonly used as indicated at 516 , 518 , 526 , 528 , and 538 , 540 , respectively.
  • the full load of training is provided as indicated at 518 , modules are selected at 520 , and completed training modules are documented at 522 .
  • training not yet completed is supplied at 530 , training modules are selected at 532 , and completed training modules are documented at 534 .
  • the equipment training options are provided at 542 , modules selected at 544 , and training is documented at 546 .
  • Training generally can be requested by the operator as indicated at 550 with similar steps of logging in, loading training, selecting modules, and documentation of completed training modules as indicated at 550 , 552 , 554 , 556 , and 558 .
  • Status update following work completed provides status information to knowledge system 10 and follows a similar pattern with logging in, documenting completed job tasks, documenting equipment maintenance completion, and confirming or updating the equipment location as indicated at steps 562 , 564 , 566 , 568 , 570 , and 572 .
  • FIG. 6A shows one possible embodiment of a HUD (heads up display) 600 that may be utilized in accord with the present invention.
  • HUD type devices and peripheral equipment are disclosed in the following patents and patent applications: U.S. D706,780; U.S. D704,705; WO CA2012/050,121; U.S. Ser. No. 13/501,735; U.S. Ser. No. 13/522,684; WO CA2011/050,023; WO CA2013/050,440; U.S. Ser. No. 14/075,982 all of which are incorporated herein by reference.
  • HUD 600 is in communication with industrial knowledge system 10 and receives data such as step-by-step instructions therefrom.
  • HUD 600 is comprised of intrinsically safe material so that HUD 600 can be utilized in an industrial environment.
  • HUD 600 is intrinsically safe because HUD 600 is designed to be incapable of producing heat or spark sufficient to ignite an explosive atmosphere.
  • HUD 600 comprises a rugged case and construction rated to protect against drops to securely and safely seal the electronics inside.
  • HUD 600 The primary concept behind intrinsic safety of HUD 600 is the restriction of available electrical and thermal energy in the system so that ignition of a hazardous atmosphere (explosive gas or dust) cannot occur. In one embodiment, this is achieved by ensuring that only acceptably low voltages and currents enter the hazardous area.
  • a galvanic isolation barrier may be formed. In this case, the barrier does not exceed approved levels of voltage and current.
  • the internal components of HUD 600 may be sealed by O-rings, rubberized or plastic casings, and the like. The devices may mounted in a low pressure room or the like or seal internal components at a lower pressure or be mounted within oil or the like.
  • safety glass 602 is utilized for the lenses, which may be ANSI Z87.1-2003 compliant.
  • HUD 600 communicates with Bluetooth low energy signals from transmitters 230 on the assets and can also communicate directly with knowledge system 10 via Bluetooth low energy signals, wireless signals, cell phone signals, and the like.
  • instructions for each asset from knowledge system 10 could also be stored with the asset for transmission by transmitters 230 .
  • the asset communicates directly with integrated knowledge system 10 , such as through data server 228 , then selected asset information from industrial knowledge system 10 may be sent utilizing transmitters 230 positioned on the asset.
  • transmitters 230 may send various types of information such as asset status, location, and even operation information including how-to information with job procedures.
  • HUD 600 may store information from integrated knowledge system 10 concerning how-to information with job procedures.
  • HUD 600 may be relocated to contact integrated knowledge system 10 as deemed necessary by the operator if communication with knowledge system 10 is not available at the exact location of the asset.
  • HUD 600 may have numerous features including, but not limited to, high resolution display 604 . Safety glass construction is utilized for the lenses. HUD 600 may include gaze detection. Gaze detection may be utilized to direct the attention of the operator to specific features to be serviced. HUD 600 may comprise a high definition camera 606 with microphone and speaker. Microphone 608 may or may not be utilized to provide for vocally activated commands for hands free operation. Optical touchpad 610 may be utilized. Bluetooth, GPS, and/or other types of internal antennas 612 can be utilized. HUD 600 may comprise a remote battery connector 614 that allows connection to extended life battery 652 as depicted in FIG. 6B . Other internal components may comprise GPS, on-board gyroscope, accelerometer, magnetometer, altimeter, thermometer, and/or dual core computer or the like.
  • the HUD is provided in intrinsically safe construction.
  • the electronics may be provided in a rubberized casing for high definition camera 606 and other internal electronics 612 .
  • internal components such as container walls may be O-ringed sealed and/or filled with oil to suppress any possibility of sparks. Commands may go through optical touchpad 610 or voice control using microphone 608 to eliminate external switches.
  • other techniques may also be utilized to provide intrinsically safe construction of HUD 600 .
  • FIG. 6B shows the possibility of providing a remotely located extended life battery 652 on a hard hat 650 where the battery will be in close proximity to HUD 600 .
  • Battery 652 may connect with remote battery connector 614 to power HUD 600 and/or the battery in HUD may be replaceable.
  • An intrinsically safe O-ring sealed connector design may be utilized for this purpose whereby the O-rings seal before contact is made. Under certain conditions, such as cold weather and the like, battery life may be greatly reduced making it desirable to have additional battery power stored and connected in an intrinsically safe manner with suitable wiring.
  • the battery is preferably located in intrinsically safe compartment 654 in the hard hat, which is sealed with 0 -rings, perhaps coated with oil, and may comprise plastic or rubberized container walls.
  • the industrial knowledge system 10 communicates with operators through HUD 600 to provide instructions for maintenance of the selected industrial equipment assets.
  • HUD screen can be attached to an arm that pivots down and up from its attachment to the side of the helmet.
  • the HUD screen alone is clipped onto and off of the lens of the safety glass.
  • the HUD screen alone is mounted and/or removable from the lens using suction or adhesive.
  • all components for the HUD except the screen are moved to the helmet.
  • a safety glass mounted control mechanism that can be used with industrial safety gloves is provided for the HUD.
  • the HUD device may utilize a mass charging station, which may comprise induction charging.
  • the HUD and/or helmet comprises the ability to be processed through a cleaning station.
  • the HUD may comprise numerous built in antennas including but not limited to RFID reader, GPS, cell-phone, walkie-talkie, Wi-Fi, and the like.
  • the HUD is intrinsically safe with a sealed manufactured case, perhaps filled with oil or other non-conductive fluid. Additionally, rubber casing and 0 -ring seals are provided for the battery.
  • the industrial knowledge system 10 is selectively operable for providing that the instructions are adjusted to a competency level of the operator. Because knowledge system 10 is aware of details of the competency level of the operator, additional and/or revised steps can be utilized to enhance the likelihood of job success.
  • the instructions to the particular operator can be adjusted to provide additional step-by-step work details comprising photos, videos, and detailed documentation in any areas of knowledge that knowledge system 10 detects the operator is less proficient based on the competency level of the operator from testing and job experience.
  • industrial knowledge system 10 can connect a less skilled operator performing a job function to a more skilled operator whereby interaction is through an HUD 600 , which both operators may utilize.
  • Camera 610 may be used by the less skilled operator so that the situation can be viewed by the more skilled operator. Instructions can then be given directly as though a mentor is on location during the job function.
  • each HUD comprises sufficient sound shielding to allow an operator to hear the instructions from the software system and/or another operator in an environment with sound levels greater than 95 dB.
  • system further comprises the software system being operable to permit communication between an off location HUD and off location operator to receive and send video to the first HUD whereby an off location operator can assist the operator when maintaining the industrial equipment assets.
  • industrial knowledge system 10 is operable for sending photos or videos that superimpose components on display 604 of the HUD to guide the operator in maintaining the industrial equipment asset 702 .
  • asset 702 which needs maintenance.
  • the HUD image of FIG. 7B may show the same equipment with highlighted components or markers 704 for the components to be serviced.
  • markers or indicators 704 to be serviced may be superimposed on the underlying components of equipment 702 .
  • HUD 600 is operable for displaying the superimposed components and/or indicators in alignment with the underlying components of industrial equipment asset 702 when viewed by the particular operator to guide maintenance of the industrial equipment assets.
  • highlighted components, indicators, or markers 706 may change color, shape, or otherwise indicate that servicing of those components has been completed. This feature can be especially useful when there are numerous components that must be serviced making the likelihood of successful completion of the task much higher than leaving the step of marking off components to manual methods.
  • FIG. 8 shows flowchart 800 depicting one possible embodiment of operator use of industrial knowledge system 10 .
  • a dashboard may be displayed as indicated at 804 with different options including selection of different actions as indicated at 806 including servicing an asset which begins by the receiving information from a BLE beacon as indicated at 808 .
  • HUD 600 or other devices may perform this step automatically.
  • the BLE beacon attached to the asset e.g. device 230 in FIG. 2
  • Status information may comprise whether the equipment is functional, non-functional, maintenance is need and details of that, end of service life, and the like. Status information may comprise status of the environment of the equipment such as whether the device is located in a loud area 1114 , is a dangerous asset 1120 , or the like (See FIG. 11 ).
  • the associated accounting documents may be automatically generated as indicated at 818 , 820 , 822 , 824 , and 826 including generation of a work order for the maintenance, a purchase order, the purchase order being sent to the desired locations and received on site with appropriate accounting steps such as triggering the accounts payable process.
  • Step 828 involves assigning labor and parts for the location.
  • the tools required and location is provided by industrial knowledge system 10 as indicated at 930 .
  • This information may also have been supplied at an earlier date unless the need for maintenance has just now become known.
  • Knowledge from industrial knowledge system 10 is available at this time or any time as indicated at 932 .
  • the system may go through several iterations of steps such as step 1 , step 2 , and step 3 , as indicated at steps 934 , 942 , and 948 where competency of the operator can be predetermined or refreshed as indicated at 936 , 944 , and 952 .
  • an operator can request assistance at 938 , 946 , and 954 during the pendency of the job.
  • HUD 600 can be used to receive information via telepresence help at steps 940 , 950 , and 958 . Provided that the job requires no further maintenance, then the work is completed at step 956 .
  • Additional actions available at step 806 include the ability to report and emergency and send the location of emergency as indicated at 882 and 884 , as well as the ability to open other applications at step 886 .
  • These applications may include streaming data services for well site monitoring or other third party applications as indicated at 888 and 890 .
  • Notification center 892 may be checked for tasks, alerts, messages and the like.
  • work orders can be received, accepted, converted to purchase orders, with the purchase orders sent to the correct places, received on site, and with the accounts payable activated and labor and parts assigned as indicated at 1002 , 1004 , 1006 , 1008 , 1010 , 1012 , 1014 , and 1016 .
  • Emergency related information can be received as indicated at 1018 , with emergency procedures, escape routes, and locations of personnel as indicated at 1020 , 1022 , and 1024 .
  • FIG. 11 provides flowchart 1100 for contextual alerts 1102 which may be based on location based alerts 1104 or third party sensors 1106 .
  • Location based alerts may be triggered by proximity to BLE beacons crossed as indicated at 1136 and detected by various detectors such as an HUD device or the like.
  • the BLE beacons can alert an operator to many conditions. For example, unauthorized access and reasons therefor as indicated at 1138 , 1140 , and 1142 . As another example, the BLE beacon can notify of dangerous assets, positions between two beacons, or the need for special equipment as indicated at 1144 , 1146 , and 1148 . Another type of warning could be for loud areas with a notification of hearing protection being required as indicated at 1150 and 1152 . BLE beacons can also be utilized to track activities related to changing locations, work hours, break time, and end of work day as indicated at 1154 , 1156 , 1158 , 1160 , 1162 , and 1164 .
  • Third party sensors 1106 may be utilized to track various events such as heart rate, fatigue levels, gas hazards and the like as indicated at 1108 , 1110 , 1112 .
  • heart rate or fatigue problems warnings and notifications can be sent as indicated at 1114 , 1116 , 1118 , and 1120 .
  • hazards such as dangerous gas
  • emergency triggers provide procedures, escape routes, and location of all personnel sent to supervisors as indicated at 1122 , 1124 , 1126 , and 1128 .
  • the present invention provides coordination that has not previously been available between systems or modules such as maintenance, equipment and asset tracking, regulations, how-to information, job function capability and training and delivery.
  • the present invention provides an improved system for maintaining industrial equipment assets.
  • the present invention utilizes a plurality of HUDs to guide operators for maintaining industrial equipment assets.
  • the present invention provides a central knowledge storage system for storing information, training, and controlling the HUDs.
  • the present invention provides a system and method to guide industrial maintenance of industrial equipment assets by assisting a plurality of operators in performing maintenance of the assets.
  • the assets can be each identified by transmitters such as but not limited to positioners such as Bluetooth Low Energy (BLE)'s, RFIDs, near field communicators and the like.
  • BLEs provide detailed directions to each industrial equipment asset.
  • the present invention provides a plurality of industrially hardened or intrinsically safe HUDs, which can be utilized by the plurality of operators.
  • Each HUD is operable to receive information from a respective BLE near field communicators or the like when in proximity with the respective BLE comprising identification, condition, and operation of each industrial equipment asset.
  • the HUDs may also receive cellular phone signals, GPS signals, and other wireless signals.
  • widely dispersed multiple displays of different types are utilized such as but not limited to laptops, tablets, smartphones, computers, and the like.
  • a software system is in communication with the plurality of displays of different types and the plurality of HUDs.
  • the software system being operable for utilizing the multiple displays of different types and the plurality of HUDs for training on demand by the plurality of operators at a wide range of locations for a wide range of different industrial equipment assets.
  • the software system being configured to determine and store information of competency levels for the plurality of operators of the industrial equipment assets based on the training and records of experience.
  • the software system stores current location and condition of each industrial equipment asset.
  • a first HUD is moveable by a first operator to select of the industrial equipment assets.
  • the first HUD is sufficiently industrially hardened or intrinsically safe for operation in the presence of hazardous gas.
  • the software system is in communication with a first operator through the first HUD to provide instructions for maintenance of the selected industrial equipment asset.
  • the software system being selectively operable of providing that the instructions are adjusted to a competency level of the first operator.
  • the instructions to the particular operator comprising step-by-step instructions of work details comprising photos, videos, and detailed documentation.
  • the software system is operable for sending photos or videos that superimpose components on a screen of the first HUD to guide the operator in maintaining the industrial equipment asset.
  • the first HUD is operable for displaying the superimposed components in alignment with the industrial equipment asset when viewed by the particular operator to guide maintenance of the industrial equipment assets.
  • each HUD comprises sufficient sound shielding to allow an operator to hear the instructions from the software system and/or another operator in an environment with sound levels greater than 95 dB.
  • system further comprises the software system being operable to permit communication between an off location HUD and off location operator to receive and send video to the first HUD whereby an off location operator can assist the operator when maintaining the industrial equipment assets.
  • system further comprises a hard hat with an intrinsically safe compartment to provide an extended life battery pack for use with the first HUD, and a remote battery connector on the first HUD.

Abstract

A knowledge system is provided that is operable for producing how-to segments of information for use with a maintenance system, an equipment and asset tracking system, and a job function competency system to utilize a plurality of types of display devices for maintaining a plurality of types of industrial assets located at a plurality of locations. In one embodiment, a low energy communicator is mounted to said each of said plurality of industrial equipment assets and operable for providing more precise location information of a selected industrial equipment asset.

Description

  • This application claims benefit of U.S. Provisional Application 62/002,030 filed on May 22, 2014.
  • BACKGROUND OF THE INVENTION
  • (1) Field of the Invention
  • The present invention relates generally to knowledge-based systems, and more specifically to an industrial knowledge system and method that provides improved asset maintenance and operation.
  • (2) Description of the Prior Art
  • In industry, systems or modules of knowledge for asset tracking, maintenance scheduling and documentation, training records, work details, regulations and “how to” information are well known. However, they are developed in different ways, generally for different purposes, and contained in different formats and systems.
  • In working with many different types of assets spread over wide locations, work details, asset specific “how to” information, tools required for specific equipment, personnel qualifications, location of qualified personnel, equipment status, regulations for specific assets, and other factors for a particular asset or piece of equipment may be difficult to quickly locate.
  • As one example, if the job function competency of specific operators within a group of operators to be tasked with assets or equipment utilization is suitable, may not be suitable, or could be suitable with additional assistance for a particular asset, this information may not be readily available to supervisors. Job function competency may not be specifically tied to the existing assets and regulations. Regulator and industry standards, which must be met, may be difficult to locate for an asset or piece of equipment and/or may not be readily available in a practical useable form for the operator that is tasked with the asset or equipment utilization.
  • Further, the individual systems or modules discussed above have internal limitations. For example, maintenance systems may not have information such as the current location of an asset or piece of equipment, the current condition, or the last person to interact with the asset. Maintenance scheduling is often based on calendar dates rather than asset condition, location and degree of utilization.
  • In the prior art, job function knowledge transfer is conducted largely by the following methods: use of peers or a mentor, classroom settings, and manuals. While of benefit, these techniques fall short of providing that an operator is prepared for the desired maintenance or job performance.
  • For example, a peer or mentor may show a new hire the job functions of the position by use of a shadowing method of following the peer or mentor around observing the job function first hand. The issues with this methodology may include, but are not limited to: the peer or mentor may not know the correct or safest procedures, the peer or mentor may not be properly trained or experienced, and the peer or mentor may not have the proper patience to conduct the knowledge transfer. Some mentors or peers may not have adequate time to demonstrate the process step-by-step, and may have trouble clearly communicating the objectives of the knowledge transfer. Further, the mentor must devote considerable time to a very limited number or trainees.
  • Knowledge transfer by class room setting is another method used for specific components of job functions. This methodology uses a group setting within a classroom to discuss and review processes and procedures of the job function. Classroom training is normally scheduled when sufficient numbers of students are available for training, not when the training is required by the individual student. Classroom-based training is typically not able to reproduce the work environment that is required by the job function. Accordingly, this methodology necessitates a high degree of organization, considerable downtime of trainees, and higher costs.
  • In the prior art, training events are not easily scheduled prior or during a job function to confirm understanding or competency of the asset or job function. Records of such training events, when available, are often not updated immediately.
  • Knowledge transfer is also typically made by use of documentation such as books, specification books or procedure manuals. However, the manuals are not always conveniently located for access at the asset location and finding the required information within the manuals or books can be very difficult. Furthermore, printed materials are more difficult to keep updated and can be very costly.
  • In the prior art, the process of identifying, documenting, logging, tracking, scheduling, training for and conducting a job function may typically include the following steps which normally must be performed in a linear way because each step depends on the previous step being completed: (1) documenting the job task and identifying the job functional requirements, (2) documenting and logging the equipment and asset maintenance requirements and maintenance interval schedules, and (3) documenting and logging the location and status of the equipment and assets. Other steps may include (4) conferring with regulatory requirements, industry standards or company policies, (5) developing “How To” information and job procedures, (6) updating or modifying job function competencies, (7) developing training segments or courses as defined by the job task requirements, (8) selecting a mentor or organizing a training course, (9) logging training taken and training required, and (10) scheduling refresher training as required by the job function.
  • This process is strictly linear, and key steps are oftentimes delayed or skipped completely. It is also difficult to have coordination between maintenance and operational requirements, along with personnel capability and availability. Furthermore, there is an inability to coordinate steps effectively amongst the process, with no available status views or overview capability.
  • The prior art systems discussed above have numerous problems that have not been addressed. Accordingly, those of skill in the art will appreciate the present invention, which addresses the above discussed problems.
  • SUMMARY OF THE INVENTION
  • Accordingly, an object of the present invention is to provide a workforce that is more efficiently trained to service a plurality of different types of assets located at a plurality of locations.
  • Another object of the present invention is to provide improved maintenance of a plurality of different types of assets located at a plurality of locations.
  • Another object of the present invention is a system that operates with different types of display devices at a plurality of locations.
  • Other objects and advantages of the present invention will be apparent from a review of the specification of the present invention.
  • Accordingly, in one possible non-limiting embodiment, the present invention provides a system to guide industrial maintenance of industrial equipment assets for a user in oil and gas operations. The invention comprises at least one computer for implementing an industrial knowledge system. The industrial knowledge system may comprise a plurality of how-to segments to perform job procedures for maintaining a plurality of industrial equipment assets.
  • The industrial knowledge system is operable for delivering how-to segments for viewing by users for a selected job procedure for maintaining a selected industrial equipment asset on a selectable display device at a plurality of locations. The how-to segments comprise step-by-step instructions including photos, videos, and/or selectable documentation.
  • A maintenance tracking and scheduling system for the industrial knowledge system comprises maintenance schedules and asset maintenance status for the selected industrial equipment asset.
  • A regulations and standards system for the industrial knowledge system comprises regulations and standards for the selected industrial equipment asset. The how-to segments incorporate respective of the regulations and standards.
  • An asset tracking system for the industrial knowledge system may comprise location information for the selected industrial equipment asset and/or location information of competent operators for servicing the asset.
  • The system may further comprise a training delivery and records system.
  • The industrial knowledge system is operable for delivering the maintenance and schedules, regulations and standards, training, and location information for the selected industrial equipment asset for viewing by the user on a selectable display device at the plurality of locations.
  • The system may further comprise a job function competency system for the industrial knowledge system with industry or company defined requirements for the job function for the selected industrial equipment asset.
  • The how-to segments and the training incorporate industry or company defined requirements. The job function competency system is operable for rating the competency of the user for a selected job function.
  • In yet another possible embodiment, an industrial knowledge system may comprise a job task module with a plurality of job tasks to be performed on a plurality of the industrial equipment assets by the operators. A maintenance module may comprise required tooling for each job task for each of the plurality of industrial equipment assets to be utilized by the operators. An asset location module may comprise respective locations of the plurality of industrial equipment assets.
  • A low power near field transmitter/receiver is preferably associated with each of the plurality of industrial equipment assets for a precise location of a selected industrial equipment asset and/or status information of the asset. The transmitter/receiver can be operable for transmitting/receiving electromagnetic waves.
  • An accounting module is operable for producing a purchase order for maintenance of the selected industrial equipment asset and a teaching module may comprise how-to information linked to the accounting module.
  • An intrinsically safe heads up display (HUD) may be worn by the operator to guide by display industrial maintenance on the industrial equipment asset. The HUD is operable to receive information from the low energy near field communicator, which may comprise location, identification, and status of the industrial equipment asset.
  • The system may further comprise a hard hat with an intrinsically safe compartment wherein an extended life battery pack for use with the HUD is mounted in the intrinsically safe compartment.
  • System software is operable for communication with a plurality of display devices which may comprise laptops, tablets, cell phones, and computer workstations at a plurality of different locations. The system software is operable for utilizing display devices including the HUD for training on demand of the operator at a selected location of the industrial equipment asset. The system software is configured to determine and store information of a competency level for the operator of the industrial equipment asset based on the training and records of experience.
  • The system software is in interactive communication with the operator through the HUD to provide instructions for maintenance of the selected industrial equipment asset. The system software is selectively operable for providing that the instructions are adjusted to a competency level of the operator. The instructions to the operator may comprise step-by-step work details with photos, videos, and detailed documentation. The system software can be operable for sending photos or videos that superimpose components on a screen of the HUD to guide the operator in maintaining the industrial equipment asset.
  • In one embodiment, the HUD is operable to receive information from the low energy near field communicator which may comprise location, identification, and status of the industrial equipment asset. The system software is in interactive communication with the operator through the HUD and/or other display devices to provide instructions for maintenance of the selected industrial equipment asset.
  • In one embodiment, the system software is selectively operable for providing that the instructions are adjusted to a competency level of the operator.
  • In one possible embodiment, the system software is operable for sending a superimposed indicator representative of an underlying component of the industrial equipment asset for display by the HUD. The superimposed indictor can be aligned with the underlying asset component requiring servicing when viewed by the operator. The superimposed indicator may change after the underlying asset component is serviced thereby allowing easier tracking of completion of a plurality of serviced components on the industrial equipment asset.
  • In another embodiment, the system is programmed for sending how-to information for the selected industrial equipment asset upon the production of the purchase order.
  • The system may further comprise a job function competency module operable to determine which operator or operators from a plurality of operators are competent to service a selected industrial equipment asset and/or which operators are in a definable vicinity of said selected industrial equipment asset. In one embodiment, the job function competency module cooperates with the teaching module to adjust the how-to information based on a competency level of a selected operator.
  • The system software is in interactive communication with the operator through the HUD to provide instructions for maintenance of the selected industrial equipment asset. The system software is selectively operable for providing that the instructions are adjusted to a competency level of the operator.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The drawings constitute a part of this specification and include exemplary embodiments to the invention, which may be embodied in various forms. It is to be understood that in some instances various aspects of the invention may be shown exaggerated or enlarged to facilitate an understanding of the invention.
  • FIG. 1 is a schematic illustrating systems or modules that are interconnected with the information in each system or module to provide an industrial knowledge system readily available for use as needed in accord with one possible embodiment of the invention.
  • FIG. 2 is a schematic wherein an industrial knowledge system is interactively connected to equipment and personnel through any number of computer devices at widely dispersed locations in accord with one possible embodiment of the invention.
  • FIG. 3 is a flow diagram showing steps in development of the knowledge available in an industrial knowledge system in accord with one possible embodiment of the invention.
  • FIG. 4 is a flow diagram showing an application of the industrial knowledge system for use in pre-job task evaluation, pre-job training, and on the job applications with a wide range of information for particular assets in accord with one possible embodiment of the invention.
  • FIG. 5 is a flow diagram showing interaction steps between an operator and an industrial knowledge system in accord with one possible embodiment of the invention.
  • FIG. 6A shows an HUD (heads up display) device that may be used by operators during operation or training in accord with one possible embodiment of the invention.
  • FIG. 6B shows an intrinsically safe hard hat with a locally available extended life battery pack for use with the HUD of FIG. 6A in accord with one possible embodiment of the invention.
  • FIG. 7A illustrates an asset or type of equipment to maintain in accord with one possible embodiment of the invention.
  • FIG. 7B illustrates an HUD (heads up display) image of the asset and components to service in accord with one possible embodiment of the invention.
  • FIG. 7C illustrates a superimposed picture of an HUD image with the components to service in accord with one possible embodiment of the invention.
  • FIG. 7D illustrates an HUD image with the components to be serviced where the HUD image of the components change as they are serviced in accord with one possible embodiment of the invention.
  • FIG. 8 illustrates a top level flowchart of interaction between an industrial knowledge system and an operator in accord with one possible embodiment of the invention.
  • FIG. 9 illustrates a flowchart of interaction between an industrial knowledge system and an operator during a work operation in accord with one possible embodiment of the invention.
  • FIG. 10 illustrates a flowchart of interaction between an industrial knowledge system and an operator with respect to various notifications that may be received in accord with one possible embodiment of the invention.
  • FIG. 11 illustrates a flowchart of interaction between an industrial knowledge system, an operator, and Bluetooth low energy (BLE) signals and/or other sensors with respect to various contextual situations that may arise in accord with one possible embodiment of the invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • Detailed descriptions of a preferred embodiment are provided herein. It is to be understood, however, that the present invention may be embodied in various forms. Therefore, specific details disclosed herein are not to be interpreted as limiting, but rather as a basis for the claims and as a representative basis for teaching one skilled in the art to employ the present invention in virtually any appropriately detailed system, structure or manner.
  • Referring now to the drawings and more particularly to FIG. 1 there is shown an industrial knowledge system 10 in accord with one possible embodiment of the present invention. Industrial knowledge system 10 comprises interconnected modules or systems that may generally be referred to as maintenance system 12, equipment and asset tracking system 14, regulations, standards, and policies system 16, “How To” information and job procedures system 18, job function competency system 20 and training delivery and records system 22. In one embodiment, industrial knowledge system 10 and/or components thereof may also be referred to as system software.
  • It will be seen that each of the systems or modules are linked together so that industrial knowledge system 10 is able to provide and receive information useful for more efficiently utilizing training and asset information to maintain the assets as well as continually updating the information in industrial knowledge system 10. It will also be appreciated that the modules or systems are representative and could be described differently or be organized differently and/or could be further differentiated by function.
  • Maintenance system 12 is utilized to keep track of maintenance schedules, equipment history, provide predictive maintenance, manage inventory, and keep track of costs, accounting and the like. Various software packages may be utilized for this purpose, see e.g. Tabware™. The maintenance preferably keeps track of the equipment status such as whether the equipment is in service, out of service, needs maintenance, needs replacement and the like.
  • Equipment and asset tracking module 14 may be utilized to keep track of the location of equipment whether moveable or fixed. In one embodiment, assets may be fitted with RFID or Bluetooth transmitter and/or receivers such as Bluetooth Low Energy (BLE) devices that provide precise location information that can lead an operator to a precise location. Bluetooth communicators provide the possibility of different signals being sent as compared with RFIDs, which transmit only predetermined information. Unlike RFIDs, Bluetooth communicators can originate the signal rather than respond to the signal. As well, RFIDs have a very limited transmitter range, usually considerably less than 20 meters. Lowe Energy BLE devices can send longer range signals up to 100 meters, 200 meters, or 300 meters to provide a beacon that leads a user to the very precise location of the equipment asset. GPS or written records may be associated with the equipment to provide general location information. The transmitter and/or receiver devices may include detailed information about the type of asset, asset maintenance history, status of the asset, special instructions or warnings about the asset, and the like. Where applicable, location of operators and the ability to select vicinity ranges of operators is available based on display devices with GPS functions utilized by the operators. Module 14 may also be referred to herein as an asset tracking module or system, or the like.
  • Regulations, Standards, and Policies module 16 may comprise a collection of up to date information for equipment and assets such as API (American Petroleum Institute) requirements and OSHA requirements. Module 16 may also be referred herein to as a regulations module, or the like and can include specific company regulation, rules and procedures.
  • Module 18 comprises “how to” information and job procedures and may be referred to herein as a teaching module, industrial knowledge system, knowledge based job system and the like, which has access to information from all modules. In one embodiment, knowledge system 10 communicates through knowledge based job system 18 as described in FIG. 2. However, the invention is not limited to communication through any particular system or module. The accumulation of information in knowledge base job system 18 is described in the flowchart of FIG. 4 and the application of the knowledge is shown in the flowchart of FIG. 5, discussed hereinafter. Operator interaction with knowledge based job system 18 is shown in the flowchart of FIG. 6. Specific designation of a particular module, such as knowledge base job system 18 for communications is a preferred but non-limiting embodiment. Accordingly as used herein, the industrial knowledge system 10 effectively communicates with operators and assets as described hereinafter.
  • Job function competency system or module 20 can be based on work instruction details segmented by industry standard activity coding. For instance, in one embodiment, the present invention may utilize IADC (International Association of Drilling Contractors) drilling activity codes. These work instruction details are used to provide concise segments covering specific operational details using a methodology that includes: step-by-step instruction of procedures, pictures, videos and links to industry regulations. This information may be utilized by knowledge based job system 18 as described before and discussed again in relationship to flow charts and the like. It will be appreciated that depending on the industry, standards for job competency may be industry standards and/or otherwise developed.
  • System or module 22 can provide training delivery and records of training. The wide range of training delivery is discussed hereinafter but includes pre-job training, on the job training, refresher training, step by step automated assistance, and virtual help by mentors delivered virtually anywhere. The records of job training provide that system 10 knows the competency level of the operator as compared to the job function to ensure that the operator is capable of performing the job function. Moreover, system 10 can further promote success by allowing fine tuning of job activities to the competency level of the operators, e.g., by adding instruction in areas that the operator may be less familiar.
  • Accordingly, the knowledge system 10 is a system comprising an encompassing source of information containing all relevant work instruction details for oil & gas operations such as drilling and services. The present invention is especially useful for industrial applications with oil and gas being an example given herein. In one embodiment, company work instruction details are segmented by industry standard activity coding, known as IADC (International Association of Drilling Contractors) drilling activity codes. These work instruction details are used to provide concise segments covering specific operational details using a methodology that includes: step-by-step instructions of procedures, pictures, videos and links to industry regulations.
  • Accordingly, the software systems and contained functions, knowledge status and schedules of system 10 are linked together. “Information containing” software systems with relationships to each other for a given task or job function with the ability to monitor and report status, condition, schedules, regulations, procedures, policies, training requirements and competencies, as needed and when needed.
  • As non-limiting examples, each of modules 12, 14, 16, 18, 20 and 22 are linked and viewable from a laptop computer, touch screen monitor computer, tablet computer, smartphone/PDA and/or HUD glasses. There may be any number of devices such as this and these devices may be located at a wide number of different locations.
  • As non-limiting examples, the present invention can directed to the Oil & Gas Industry, the drilling segment of the Oil & Gas Industry, the refinery segment of the Oil and Gas Industry, and/or to rig operations of the drilling segment of the Oil & Gas Industry.
  • In one embodiment, the work instruction details are termed “How To Guides” and include detailed description of the active subject work, required tools or tooling, any specific knowledge or know-how, all precautions, cautions and warning related to the specific job task. The “How To Guides” are used to provide clear role responsibility for all involved personnel.
  • In support of the objective “How To Guides”, all supporting documentation, regulatory requirements, specific training requirements and operational systems access are made available to all involved personnel by use of industrial knowledge system 10.
  • Referring now to knowledge flow diagram FIG. 2, there is shown industrial knowledge system 10 delivering information to and receiving information from numerous locations in system 200. As discussed herein before, knowledge system 10 may communicate through specific modules or systems discussed therein with respect to FIG. 1, such as module 18, which involves a training module linked with other modules described hereinbefore.
  • To accommodate the operator's schedule and preference for training, training can be supplied on many different types of devices at virtually any time and in many different formats including written, video, pictures, communications with mentors, and/or combinations of these. The training materials can be delivered over wide spread locations.
  • Some non-limiting examples of types of devices that can be utilized for training include laptops 202, tablets 204, cell phones 206, and computer workstations 208. System 200 is interactive with these devices and accumulates job competency information for operators. Other information such as operator location information and the like may be received by knowledge system 10, which may be used for dispatching competent operators within a desired vicinity of equipment to be serviced.
  • In yet another embodiment, integrated knowledge system 10 may be utilized to supply and receive information from components of an LMS (learning management system) server 210. Learning management systems are utilized in various corporate environments and are excellent for many purposes, but do not in and of themselves provide the knowledge that must be taught. Integrated knowledge system 10 provides the necessary content. LMS server 210 may be utilized for various purposes, such as, but not limited to creation of class rosters, control over registration processes, and the ability to create waiting lists. Other functions may include uploading and management of documents containing curricular content, delivery of course content over web-based interfaces, most often allowing remote participation by the instructor or pupil.
  • LMS server 210 may be used for creation and publication of course calendars, interaction between students, such as instant messaging, email, and discussion forums, methods of assessment and testing (like creating pop quizzes). LMS systems used in corporate training environments often have additional features that satisfy goals relating to knowledge management and performance evaluation, such as: automatic enrollment and reminders for mandatory courses, options for manager access, such as to approve materials or participation, integration with human resource systems for tracking employment eligibility, performance goals, and similar corporate priorities, and control over access and class groupings according to a number of metrics, such as geography, involvement in a particular project, or levels of security clearance.
  • Logging into system 210 by users such as user 212 may be accomplished by password, RFID, Bluetooth or the like. The devices may comprise RFID readers such as RFID reader 216 utilized with cell phone 206. Thus, RFID readers for devices or other types of sensors such as biometric sensors or the like may be conveniently used for logging into the system. Alternatively, passwords or other types of recognition devices may be utilized.
  • System 200 can deliver on the job information to operators 218 over PDA (personal digital assistant) 220 or HUD (heads up display) glasses 600. HUD glasses 600 may automatically detect operators using RFID devices carried by operators. HUD 600 can detect equipment, such as equipment or asset 226 by Bluetooth and/or RFID 612. Assets such as asset 226 may be connected to data server 228 to provide location data, maintenance requirements, status and the like, which is stored and utilized by industrial knowledge system 10. However, if assets are not connected through servers to system 10, the status of assets can also be provided to industrial knowledge system 10 by operators through HUD 600 or other devices that connect to system 10.
  • Bluetooth transponders, such as Bluetooth Low Energy (BLE) devices 230 may be used to provide very precise location information for moveable equipment 226. GPS devices 232, transport information, rig records, or the like may be used with moveable equipment to provide general location information. BLE device 230 is not limited to line-of-sight transmission. Fixed or less moveable equipment may also be monitored by similar sensors or at least listed with location information. Device 230 may be referred to herein as a low power transmitter, low energy transmitter, low energy near field communicator, or the like.
  • In another embodiment BLE devices 230 may interact with HUD devices 600 or other display devices to lead operators such as operator 218 to precise locations, provide equipment status and identification information, and the like. The precise location is more than general location information provided by GPS devices, or written records because the operator is led to the BLE device carried by operator 218 by physically searching for it. This may be necessary and highly desirable in some locations. BLE device 230 is preferably limited in transmission to up to 100 meters, 200 meters, or three hundred meter ranges depending transmitter design and the overall metal clutter of the location. RFID is a transponder to an audio signal, unlike Bluetooth which provides two-way electrical wave communication, and does not provide precise location information more than 10 or 20 meters away and may have a range considerably less than that. Accordingly, RFID is less useful for locating equipment 226 on a cluttered or storage location.
  • Referring now to FIG. 3 there is shown flowchart 300, which relates to the systems or modules discussed in FIG. 1. Flowchart 300 describes development of knowledge content for integrated information system 10. In one possible embodiment, the accumulated knowledge could be implemented through system or module 18 from FIG. 1 that provides “how to” information and job procedures, which is linked to the other modules of FIG. 1.
  • The present invention provides an integrated approach to knowledge documentation, knowledge transfer and event scheduling, tracking and logging. With the industrial knowledge system 10 procedures can be concurrently developed, tracked and logged into the linked systems.
  • Current development or procedures is possible due to the inking together of information containing software systems as shown in FIG. 1 by linked arrow bus 336. Linked arrow bus 336 indicates an information flow whereby developers of any particular step or module, as discussed below, can utilize information from any other module. This is not possible in the prior art as discussed hereinbefore.
  • In step 310, the present invention documents job function requirements required for job function competency. In one embodiment, job function requirements can be based on work instruction details segmented by industry standard activity coding for performing work on each asset. In one embodiment, the present invention utilizes IADC (International Association of Drilling Contractors) drilling activity codes to provide job function requirements. Job function requirements are evaluated and documented within integrated knowledge system 10.
  • As one example, utilizing the linked environment as indicated at 336, the job function requirements can be accessed and/or have input directly from regulatory requirements, industry standards, and company policies at step 318; available assets and equipment, including locations and maintenance status, from steps 312, 314, and 316; “know-how” and required knowledge from step 320; “how-to” information and job procedures from step 322; and required training and current training status from at least one of steps 326 and 328.
  • As one example, determining a job function requirement may comprise a series of steps for performing a job task, e.g., changing oil: (1) asset updates (different type of oil required due to new piston rings; predetermined time intervals to change oil), (2) tooling (branched container for oil), (3) locating asset (current location), (4) maintenance requirements (changing oil based on asset's time in operation rather than at fixed time intervals), (5) compliance with regulatory requirements (disposal requirements which change over time).
  • As used herein, a job task is a job to be performed, e.g., changing the oil of an asset. The job tasks involve specific tasks to be used with equipment or assets to be maintained, operational functions, and the like. However, job tasks may also be defined within a company or industry as the tasks that need to be completed for specific jobs.
  • Although straight flow arrows are provided in FIG. 3, the steps of FIG. 3 are not necessarily performed in linear fashion and can largely be performed in different order or simultaneously with links as indicated by bus 336. Steps 312 through 318 can be performed in any sequence including being simultaneously performed.
  • Due to linking, reiteration over time continues to improve the system. For example, step 328 may be repeatedly performed over time as refined information becomes available concerning the effectiveness of the training segments with respect to successful task completion. The related modules are readily available to be updated as desired.
  • Step 312 documents the required equipment, the assets to be worked with, and the types of tools needed to perform any particular job task. Accordingly, each operator will have a check list of tools needed, which makes job success and completion more likely to be efficiently and quickly accomplished.
  • Step 314 provides that the availability and location of the tools and assets be provided within integrated knowledge system 10. In this way, the logistics of these items are available for use by operators in conjunction with step 316, which sets forth the maintenance requirements. This type of complete information available from industrial knowledge system 10 provides significant time savings in coordinating schedules and plans.
  • Step 318 provides that the existing regulatory requirements, industry standards, and company policies for the job tasks is readily available. In one embodiment, this information may comprise API (American Petroleum Institute) requirements and OSHA requirements, which are up to date and preferably include index search capability.
  • Step 320 takes the information of 310 to 318, and any other relevant information, and documents the required knowledge and/or know-how required to complete the job tasks that have been listed. Required Knowledge and Know-How 320 provides an understanding of job procedures and the reasons behind the job procedures.
  • From the above information, in step 322 experts may be utilized to document the how-to information or how-to segments of information for performing the job tasks. This may include listing or developing procedures that have been known to be effective in successfully completing the job tasks. Job procedures are more detailed instructions required to complete the generic steps in the job function requirements, e.g., for changing the oil this may comprise switching to back up motor, shut down motor, and let cool down. How-to segments of information provide training in video/words/voice for the required knowledge and know-how with each detail of the job procedures being explained.
  • With the above developed information, it becomes possible to create, update, and/or modify descriptions of job function competencies as indicated at step 324. Job function competency 324 can be training requirements that document the user has acquired the required knowledge which indicates a competency level to perform the job task. A time-stamp may be utilized to document this. This can be readily changed over time as desired to more accurately reflect the desired level of training.
  • For implementation of step 326, it will be appreciated that considerable information is now readily available to develop training segments or courses that can be used to teach operators how to successfully complete the job tasks because the requirements are known. Training segment instruction details are used to provide concise segments covering specific operational details using a methodology that includes: Step-by-step instructions of procedures, pictures, videos and links to industry regulations. This information may be utilized by knowledge based job system 18 as described before and discussed again in relationship to flow charts and the like. It will be appreciated that depending on the industry, standards for job competency may be industry standards and/or otherwise developed.
  • As noted above with regard to step 326, over time the courses and training segments can be revised and refined for each task. Step 328 reviews the training segments or courses as required by job task. As discussed above, step 328 may be repeatedly performed as information becomes available concerning the effectiveness of the training segments with respect to successful task completion.
  • In step 330, portals for knowledge transfer are developed. These portals are used to provide training segments and courses as needed. For example, as shown in FIG. 2, numerous portals may be utilized. The operators such as operator 212 may directly access the training segments and courses on an as desired basis whenever and wherever they may be utilizing a wide range of different types of delivery items prior to performing the job tasks or as refresher courses. Training systems may be utilized as discussed above with respect to LMS server 210.
  • On the job, step-by-step guidance and/or help may be utilized. For example, HUD glasses 600 may show components on the equipment to be serviced. Step-by-step instructions may be provided for each component. The components may be overlaid or indicated with indicators that could be selected for this purpose as shown in FIG. 7A-7D.
  • In another embodiment, HUD glasses 600 may broadcast video from the operator on the job to more experienced personnel such as supervisors who can guide a less experienced local operator successfully through successful completion of the job task. For that matter, experienced personnel may be utilized to oversee numerous lesser experienced operators from remote locations. The job function competency level of the less experienced operators may be at a level sufficient to believe that with additional help from the experienced operators that the job will be completed successfully.
  • In step 332, post training segments or courses are available through the various portals. These segments can be used to further solidify the knowledge required for successful completion of job tasks. The delivery can be made through numerous portals discussed above which can be implemented through the Internet, company Intranets, downloaded files stored on display devices, or the like. The segments or courses can be delivered to different types of display devices such as HUD devices, laptop computers, touch screen monitor computers, tablet computers, smartphone/PDAs, and the like.
  • In step 334, the training requirements, availability for training courses and schedules is provided. In the above way, the knowledge for industrial knowledge system 10 is developed. The development is typically ongoing, revised for new types of equipment, and remains an invaluable source of information developed and tested over time.
  • Accordingly, an integrated approach to knowledge documentation, knowledge transfer and event scheduling, tracking and logging is provided. With the concept of integrated knowledge system 10, process and Know-How procedures can be concurrently developed, tracked and logged into the linked systems 12, 14, 16, 18, 20, and 22 of FIG. 1.
  • Maintenance tracking and scheduling system 12, equipment and asset tracking system 14, regulation, standards and policies system 16, “How To” information and job procedures system 18, job function competencies system training delivery 20, and tracking and records system 22 can be embedded or linked when using integrated knowledge system 10 and viewable from a laptop computer, touch screen monitor computer, tablet computer, smartphone/PDA and/or HUD glasses.
  • FIG. 4 provides flowchart 400 of the application or structure of industrial knowledge system 10 to specific job tasks, assets, and operators.
  • Step 402 provides for a pre-job task evaluation. At step 404, the job task function, already defined above, can be reviewed, but has already been determined, and is available from industrial knowledge system 10. The required training to complete the job task is indicated at step 406, which allows selection or location of a competent operator.
  • As per steps 408 and 410, the equipment required to perform the job task can be obtained from knowledge system 10. The location of the equipment or tooling is also provided. Knowledge system 10 can also provide the status or condition of the equipment or tooling that is necessary to service as indicated at 412.
  • Industrial knowledge system 10 provides the information for the required pre-job training as indicated at 416. As discussed above, online training is available utilizing many different types of devices and at widely dispersed locations as indicated at 418. Knowledge system 10 provides documentation of completion of training, understanding of regulatory requirements, as indicated at 420 and 422. Job function competency check information documentation for particular operations and operators is stored as indicated at 424. Accordingly, the job function competency module 20, and as discussed at 424 is operable to determine whether any particular operator from a plurality of operators has a competency level to service a selected industrial equipment asset. In one possible embodiment, job function competency module 20 may be programmed to provide a determination whether any particular operator has a competency level to service said selected industrial equipment asset with additional support for a selected industrial equipment asset utilizing a selective connection to a second operator with a display device such as a lap top, tablet, heads up display, or the like, for additional support for said selected industrial equipment asset. The competency level for this may be close to but perhaps not yet at the preferred competency level based on education completed and/or time of service. The second operator may be a supervisor at another location.
  • Industrial knowledge system 10 can be utilized as the task is being performed, as indicated at 426. Thus, considerable help is always available to the operator not only before the job but as the job is actually performed.
  • As indicated at 428, proximity sensors can be utilized to locate the equipment of interest as discussed previously. GPS, RFID, and Bluetooth are all available for this purpose. However, GPS may not be quite as accurate and may be limited to general location information especially for smaller equipment that may be more difficult to locate. For example, BLE (Bluetooth low energy) beacons or the like can be utilized to provide highly precise location information to the operator who is in the vicinity of the asset utilizing the general location information. These beacons may provide precise location information that is available over longer distances, e.g. 100 meters, than is available through RFID and are more accurate than GPS.
  • As indicated at 430 and 440, information about the asset is available with displays discussed earlier and/or an HUD device. In steps 442, 444, 446, and 448, status information may include whether the equipment is functional or non-functional, whether maintenance is needed and whether the service life of the equipment or asset has come to an end.
  • In step 450, industrial knowledge system 10 provides on the job content such as step by step instructions, which may be in the form of images, written instructions, and the like. Superimposed indicators and/or other images that highlight and keep track of functions to be performed or items to be maintained may be sent via HUD devices as indicated by HUD device 600 discussed with respect to FIG. 2 and in more detail with respect to FIG. 6A and FIG. 7A-7D.
  • In step 452, the industrial knowledge system 10 documents completion of courses and/or refresher training. The system will also provide information about the successful completion of the job and provide for use that information for revision of the how-to segment instructions if deemed desirable.
  • In step 454, industrial knowledge system 10 updates the database on the equipment or tooling, the asset or tooling status, and other information required for continued status of the assets, tools, and the operators.
  • Accordingly, the application of knowledge transfer based training is provided using direct access training modules. The training lists required tooling and associated documentation. The system provides use of index search capability and step-by-step work details featuring photos, videos detailed documentation. PDF printout capability is available to training “How to Guides” sent directly to the work site.
  • While the information is available at a wide range of locations, the information can also be provided to a touch screen computer in a centralized location available to personnel. At the various work sites, training can be made directly to portable laptop computers, computer tablets, smartphones or PDAs, and HUDs.
  • FIG. 5 shows flow chart 500, which provides one possible embodiment of interaction between operators and industrial knowledge system 10. FIG. 5 is a basic diagram with many possible variations. The operator initiates the connection, receives acknowledgment, initializes the application of the training and selects the type of device to receive knowledge in steps 502, 504, 506, and 508. The mode is selected to set up the type of training that will be requested as indicated at 510. If the job task mode is selected, then the user is directed to 512. Depending on whether the user is a new hire, is seeking a new role, or looking for a refresher course, the user is directed to 514, 524, or 536. The user can log into the system in various ways, with RFID tags or passwords being the most commonly used as indicated at 516, 518, 526, 528, and 538, 540, respectively.
  • For the new hire, the full load of training is provided as indicated at 518, modules are selected at 520, and completed training modules are documented at 522.
  • When a new role is requested for an ongoing hire, then training not yet completed is supplied at 530, training modules are selected at 532, and completed training modules are documented at 534.
  • For refresher courses, the equipment training options are provided at 542, modules selected at 544, and training is documented at 546.
  • Training generally can be requested by the operator as indicated at 550 with similar steps of logging in, loading training, selecting modules, and documentation of completed training modules as indicated at 550, 552, 554, 556, and 558.
  • Status update following work completed provides status information to knowledge system 10 and follows a similar pattern with logging in, documenting completed job tasks, documenting equipment maintenance completion, and confirming or updating the equipment location as indicated at steps 562, 564, 566, 568, 570, and 572.
  • FIG. 6A shows one possible embodiment of a HUD (heads up display) 600 that may be utilized in accord with the present invention. Examples of HUD type devices and peripheral equipment are disclosed in the following patents and patent applications: U.S. D706,780; U.S. D704,705; WO CA2012/050,121; U.S. Ser. No. 13/501,735; U.S. Ser. No. 13/522,684; WO CA2011/050,023; WO CA2013/050,440; U.S. Ser. No. 14/075,982 all of which are incorporated herein by reference. HUD 600 is in communication with industrial knowledge system 10 and receives data such as step-by-step instructions therefrom.
  • One embodiment of HUD 600 is comprised of intrinsically safe material so that HUD 600 can be utilized in an industrial environment. As used herein HUD 600 is intrinsically safe because HUD 600 is designed to be incapable of producing heat or spark sufficient to ignite an explosive atmosphere. In one preferred embodiment, HUD 600 comprises a rugged case and construction rated to protect against drops to securely and safely seal the electronics inside.
  • The primary concept behind intrinsic safety of HUD 600 is the restriction of available electrical and thermal energy in the system so that ignition of a hazardous atmosphere (explosive gas or dust) cannot occur. In one embodiment, this is achieved by ensuring that only acceptably low voltages and currents enter the hazardous area.
  • In one embodiment, a galvanic isolation barrier may be formed. In this case, the barrier does not exceed approved levels of voltage and current. In another embodiment, the internal components of HUD 600 may be sealed by O-rings, rubberized or plastic casings, and the like. The devices may mounted in a low pressure room or the like or seal internal components at a lower pressure or be mounted within oil or the like.
  • In one embodiment safety glass 602 is utilized for the lenses, which may be ANSI Z87.1-2003 compliant.
  • As noted hereinbefore, in one preferred embodiment HUD 600 communicates with Bluetooth low energy signals from transmitters 230 on the assets and can also communicate directly with knowledge system 10 via Bluetooth low energy signals, wireless signals, cell phone signals, and the like.
  • In one embodiment, instructions for each asset from knowledge system 10 could also be stored with the asset for transmission by transmitters 230. If the asset communicates directly with integrated knowledge system 10, such as through data server 228, then selected asset information from industrial knowledge system 10 may be sent utilizing transmitters 230 positioned on the asset. Accordingly, in one embodiment, transmitters 230 may send various types of information such as asset status, location, and even operation information including how-to information with job procedures. As well, HUD 600 may store information from integrated knowledge system 10 concerning how-to information with job procedures. In another embodiment, HUD 600 may be relocated to contact integrated knowledge system 10 as deemed necessary by the operator if communication with knowledge system 10 is not available at the exact location of the asset.
  • HUD 600 may have numerous features including, but not limited to, high resolution display 604. Safety glass construction is utilized for the lenses. HUD 600 may include gaze detection. Gaze detection may be utilized to direct the attention of the operator to specific features to be serviced. HUD 600 may comprise a high definition camera 606 with microphone and speaker. Microphone 608 may or may not be utilized to provide for vocally activated commands for hands free operation. Optical touchpad 610 may be utilized. Bluetooth, GPS, and/or other types of internal antennas 612 can be utilized. HUD 600 may comprise a remote battery connector 614 that allows connection to extended life battery 652 as depicted in FIG. 6B. Other internal components may comprise GPS, on-board gyroscope, accelerometer, magnetometer, altimeter, thermometer, and/or dual core computer or the like.
  • In one embodiment, the HUD is provided in intrinsically safe construction. The electronics may be provided in a rubberized casing for high definition camera 606 and other internal electronics 612. An LCD display or other intrinsically safe type of display 604. As well, internal components such as container walls may be O-ringed sealed and/or filled with oil to suppress any possibility of sparks. Commands may go through optical touchpad 610 or voice control using microphone 608 to eliminate external switches. However, other techniques may also be utilized to provide intrinsically safe construction of HUD 600.
  • FIG. 6B shows the possibility of providing a remotely located extended life battery 652 on a hard hat 650 where the battery will be in close proximity to HUD 600. Battery 652 may connect with remote battery connector 614 to power HUD 600 and/or the battery in HUD may be replaceable. An intrinsically safe O-ring sealed connector design may be utilized for this purpose whereby the O-rings seal before contact is made. Under certain conditions, such as cold weather and the like, battery life may be greatly reduced making it desirable to have additional battery power stored and connected in an intrinsically safe manner with suitable wiring. The battery is preferably located in intrinsically safe compartment 654 in the hard hat, which is sealed with 0-rings, perhaps coated with oil, and may comprise plastic or rubberized container walls.
  • In one embodiment of the invention, the industrial knowledge system 10 communicates with operators through HUD 600 to provide instructions for maintenance of the selected industrial equipment assets.
  • In one embodiment, HUD screen can be attached to an arm that pivots down and up from its attachment to the side of the helmet. In another embodiment, the HUD screen alone is clipped onto and off of the lens of the safety glass. In another embodiment, the HUD screen alone is mounted and/or removable from the lens using suction or adhesive. In another embodiment, all components for the HUD except the screen are moved to the helmet.
  • In another embodiment, a safety glass mounted control mechanism that can be used with industrial safety gloves is provided for the HUD. The HUD device may utilize a mass charging station, which may comprise induction charging.
  • In another embodiment, the HUD and/or helmet comprises the ability to be processed through a cleaning station.
  • The HUD may comprise numerous built in antennas including but not limited to RFID reader, GPS, cell-phone, walkie-talkie, Wi-Fi, and the like.
  • The HUD is intrinsically safe with a sealed manufactured case, perhaps filled with oil or other non-conductive fluid. Additionally, rubber casing and 0-ring seals are provided for the battery.
  • The industrial knowledge system 10 is selectively operable for providing that the instructions are adjusted to a competency level of the operator. Because knowledge system 10 is aware of details of the competency level of the operator, additional and/or revised steps can be utilized to enhance the likelihood of job success. The instructions to the particular operator can be adjusted to provide additional step-by-step work details comprising photos, videos, and detailed documentation in any areas of knowledge that knowledge system 10 detects the operator is less proficient based on the competency level of the operator from testing and job experience.
  • In another embodiment, industrial knowledge system 10 can connect a less skilled operator performing a job function to a more skilled operator whereby interaction is through an HUD 600, which both operators may utilize. Camera 610 may be used by the less skilled operator so that the situation can be viewed by the more skilled operator. Instructions can then be given directly as though a mentor is on location during the job function.
  • In another embodiment, each HUD comprises sufficient sound shielding to allow an operator to hear the instructions from the software system and/or another operator in an environment with sound levels greater than 95 dB.
  • In another embodiment, the system further comprises the software system being operable to permit communication between an off location HUD and off location operator to receive and send video to the first HUD whereby an off location operator can assist the operator when maintaining the industrial equipment assets.
  • Referring to FIG. 7A-7D, industrial knowledge system 10 is operable for sending photos or videos that superimpose components on display 604 of the HUD to guide the operator in maintaining the industrial equipment asset 702. For example, in FIG. 7A, there is shown asset 702, which needs maintenance. The HUD image of FIG. 7B may show the same equipment with highlighted components or markers 704 for the components to be serviced. For example, there may be twenty items that need to be checked or greased. In FIG. 7C, in one embodiment, the markers or indicators 704 to be serviced may be superimposed on the underlying components of equipment 702. Accordingly, in one embodiment, HUD 600 is operable for displaying the superimposed components and/or indicators in alignment with the underlying components of industrial equipment asset 702 when viewed by the particular operator to guide maintenance of the industrial equipment assets. In FIG. 7D, in one embodiment, highlighted components, indicators, or markers 706 may change color, shape, or otherwise indicate that servicing of those components has been completed. This feature can be especially useful when there are numerous components that must be serviced making the likelihood of successful completion of the task much higher than leaving the step of marking off components to manual methods.
  • FIG. 8 shows flowchart 800 depicting one possible embodiment of operator use of industrial knowledge system 10. After authentication at 802, a dashboard may be displayed as indicated at 804 with different options including selection of different actions as indicated at 806 including servicing an asset which begins by the receiving information from a BLE beacon as indicated at 808. HUD 600 or other devices may perform this step automatically. As the operator moves toward an asset, the BLE beacon attached to the asset (e.g. device 230 in FIG. 2) sends information to explain what the asset is as indicated at 810, the asset status and service history as indicated at 812 and 814 and/or maintenance instructions or additional instructions as indicated at 816, which may have already been received by the operator as discussed hereinbefore. Status information may comprise whether the equipment is functional, non-functional, maintenance is need and details of that, end of service life, and the like. Status information may comprise status of the environment of the equipment such as whether the device is located in a loud area 1114, is a dangerous asset 1120, or the like (See FIG. 11).
  • The associated accounting documents may be automatically generated as indicated at 818, 820, 822, 824, and 826 including generation of a work order for the maintenance, a purchase order, the purchase order being sent to the desired locations and received on site with appropriate accounting steps such as triggering the accounts payable process. Step 828 involves assigning labor and parts for the location.
  • Referring to FIG. 9, the tools required and location is provided by industrial knowledge system 10 as indicated at 930. This information may also have been supplied at an earlier date unless the need for maintenance has just now become known. Knowledge from industrial knowledge system 10 is available at this time or any time as indicated at 932. The system may go through several iterations of steps such as step 1, step 2, and step 3, as indicated at steps 934, 942, and 948 where competency of the operator can be predetermined or refreshed as indicated at 936, 944, and 952. Further, an operator can request assistance at 938, 946, and 954 during the pendency of the job. In one embodiment, HUD 600 can be used to receive information via telepresence help at steps 940, 950, and 958. Provided that the job requires no further maintenance, then the work is completed at step 956.
  • Referring again to FIG. 8, other action steps may be taken such as messages 860, transcribing speech to text 862, and viewing recent messages 864. Recent information from industrial information system 10 may be organized, saved, and reviewed as indicated at 866 and 868. Assets may be tagged, problems reported, pictured, and flagged for maintenance or the like as indicated at 870, 872, 874, and 876. This information may be sent to the supervisor with the report confirmed as indicated 878 and 880.
  • Additional actions available at step 806 include the ability to report and emergency and send the location of emergency as indicated at 882 and 884, as well as the ability to open other applications at step 886. These applications may include streaming data services for well site monitoring or other third party applications as indicated at 888 and 890.
  • Referring to FIG. 10, there is shown flowchart 1000 of a notification center. Notification center 892 may be checked for tasks, alerts, messages and the like. As noted earlier with respect to FIG. 8, work orders can be received, accepted, converted to purchase orders, with the purchase orders sent to the correct places, received on site, and with the accounts payable activated and labor and parts assigned as indicated at 1002, 1004, 1006, 1008, 1010, 1012, 1014, and 1016. Emergency related information can be received as indicated at 1018, with emergency procedures, escape routes, and locations of personnel as indicated at 1020, 1022, and 1024.
  • FIG. 11 provides flowchart 1100 for contextual alerts 1102 which may be based on location based alerts 1104 or third party sensors 1106. Location based alerts may be triggered by proximity to BLE beacons crossed as indicated at 1136 and detected by various detectors such as an HUD device or the like.
  • The BLE beacons, such as BLE beacon 230 of FIG. 2, can alert an operator to many conditions. For example, unauthorized access and reasons therefor as indicated at 1138, 1140, and 1142. As another example, the BLE beacon can notify of dangerous assets, positions between two beacons, or the need for special equipment as indicated at 1144, 1146, and 1148. Another type of warning could be for loud areas with a notification of hearing protection being required as indicated at 1150 and 1152. BLE beacons can also be utilized to track activities related to changing locations, work hours, break time, and end of work day as indicated at 1154, 1156, 1158, 1160, 1162, and 1164.
  • Third party sensors 1106 may be utilized to track various events such as heart rate, fatigue levels, gas hazards and the like as indicated at 1108, 1110, 1112. In the event of heart rate or fatigue problems warnings and notifications can be sent as indicated at 1114, 1116, 1118, and 1120. In the event of hazards such as dangerous gas, emergency triggers provide procedures, escape routes, and location of all personnel sent to supervisors as indicated at 1122, 1124, 1126, and 1128.
  • Accordingly, the present invention provides coordination that has not previously been available between systems or modules such as maintenance, equipment and asset tracking, regulations, how-to information, job function capability and training and delivery.
  • In summary, the present invention provides an improved system for maintaining industrial equipment assets. In one possible embodiment, the present invention utilizes a plurality of HUDs to guide operators for maintaining industrial equipment assets. In another possible embodiment, the present invention provides a central knowledge storage system for storing information, training, and controlling the HUDs.
  • The present invention provides a system and method to guide industrial maintenance of industrial equipment assets by assisting a plurality of operators in performing maintenance of the assets. In another possible embodiment, the assets can be each identified by transmitters such as but not limited to positioners such as Bluetooth Low Energy (BLE)'s, RFIDs, near field communicators and the like. The BLEs provide detailed directions to each industrial equipment asset.
  • The present invention provides a plurality of industrially hardened or intrinsically safe HUDs, which can be utilized by the plurality of operators. Each HUD is operable to receive information from a respective BLE near field communicators or the like when in proximity with the respective BLE comprising identification, condition, and operation of each industrial equipment asset. The HUDs may also receive cellular phone signals, GPS signals, and other wireless signals. In another aspect of the invention, widely dispersed multiple displays of different types are utilized such as but not limited to laptops, tablets, smartphones, computers, and the like.
  • In another aspect of the invention, a software system is in communication with the plurality of displays of different types and the plurality of HUDs. The software system being operable for utilizing the multiple displays of different types and the plurality of HUDs for training on demand by the plurality of operators at a wide range of locations for a wide range of different industrial equipment assets. The software system being configured to determine and store information of competency levels for the plurality of operators of the industrial equipment assets based on the training and records of experience. The software system stores current location and condition of each industrial equipment asset.
  • As another aspect of the invention, a first HUD is moveable by a first operator to select of the industrial equipment assets. The first HUD is sufficiently industrially hardened or intrinsically safe for operation in the presence of hazardous gas.
  • The software system is in communication with a first operator through the first HUD to provide instructions for maintenance of the selected industrial equipment asset. The software system being selectively operable of providing that the instructions are adjusted to a competency level of the first operator. The instructions to the particular operator comprising step-by-step instructions of work details comprising photos, videos, and detailed documentation. The software system is operable for sending photos or videos that superimpose components on a screen of the first HUD to guide the operator in maintaining the industrial equipment asset. In one embodiment, the first HUD is operable for displaying the superimposed components in alignment with the industrial equipment asset when viewed by the particular operator to guide maintenance of the industrial equipment assets.
  • In another embodiment, each HUD comprises sufficient sound shielding to allow an operator to hear the instructions from the software system and/or another operator in an environment with sound levels greater than 95 dB.
  • In another embodiment, the system further comprises the software system being operable to permit communication between an off location HUD and off location operator to receive and send video to the first HUD whereby an off location operator can assist the operator when maintaining the industrial equipment assets.
  • In another embodiment, the system further comprises a hard hat with an intrinsically safe compartment to provide an extended life battery pack for use with the first HUD, and a remote battery connector on the first HUD.
  • It will be understood that many additional changes in the details, materials, steps and arrangement of parts, which have been herein described and illustrated in order to explain the nature of the invention, may be made by those skilled in the art within the principle and scope of the invention as expressed in the appended claims.
  • The foregoing description of the preferred embodiments of the invention has been presented for purposes of illustration and description only. It is not intended to be exhaustive or to limit the invention to the precise form disclosed; and obviously many modifications and variations are possible in light of the above teaching. Such modifications and variations that may be apparent to a person skilled in the art are intended to be included within the scope of this invention as defined by the accompanying claims.

Claims (20)

What is claimed is:
1. A system to guide industrial maintenance of industrial equipment assets for a user in oil and gas operations, comprising:
at least one computer comprising an industrial knowledge system, said industrial knowledge system comprising a plurality of how-to segments to perform respective job procedures for maintaining each of said industrial equipment assets, said industrial knowledge system being operable for delivering said how-to segments for viewing by said user on a selectable display device at a plurality of locations, said how-to segments comprising step-by-step instructions comprising photos, videos, and documentation for a selected industrial equipment asset;
a maintenance tracking and scheduling system for said industrial knowledge system operable for delivering maintenance schedules and asset maintenance status for viewing by said user on said selectable display device at said plurality of locations;
a regulations and standards system for said industrial knowledge system operable for delivering said regulations and standards for viewing by said user on said selectable display device at said plurality of locations, said how-to segments of information incorporating respective of said regulations and standards; and
an asset tracking system for said industrial knowledge system operable for delivering at least general location information for said selected industrial equipment asset for viewing by said user on said selectable display device at said plurality of locations.
2. The system of claim 1, further comprising a training delivery and records system for said industrial knowledge system being operable to deliver training records for viewing by said user on said selectable display device at said plurality of locations.
3. The system of claim 2, further comprising a job function competency system for said industrial knowledge system comprising industry or company defined requirements for said job function for said selected industrial equipment asset, said job function competency system being operable for rating a competency level of said user for a selected job function.
4. The system of claim 3, further comprising:
at least one low energy transmitter mounted to said selected industrial equipment asset, said at least one low energy transmitter being operable for providing more precise location information than said general location of said selected industrial equipment asset;
an intrinsically safe HUD (heads up display) to be worn by said user to guide industrial maintenance on said selected industrial equipment asset, said HUD being operable to receive said more precise location information from said low energy transmitter.
5. The system of claim 4, wherein said industrial knowledge system is selectively operable to adjust said step-by-step instructions to said competency level of said user.
6. The system of claim 4, said industrial knowledge system being operable for sending at least one of photos or videos that superimpose indicators of underlying components of said selected industrial equipment asset on a screen of said HUD to guide said operator in maintaining said selected industrial equipment asset, and wherein said indicators change in response to said step by step instructions being completed.
7. The system of claim 1, further comprising an automated job ticket generation mechanism which generates a ticket for maintaining a particular asset and sends a predetermined how-to segment of information for said particular asset.
8. A system to guide industrial maintenance of a plurality of industrial equipment assets for a user in oil and gas operations, comprising:
at least one computer comprising an industrial knowledge system, said industrial knowledge system comprising a teaching module operable to deliver how-to segments of information comprising visual and written procedures for servicing each of said plurality of industrial equipment assets, an asset tracking module comprising at least a general location for each of said plurality of industrial equipment assets, and a maintenance system with maintenance scheduling requirements for each of said plurality industrial equipment assets;
at least one low energy transmitter operable to originate a beacon signal to guide said user to a more precise location information than said general location for a particular industrial equipment asset, said at least one low energy transmitter being configured for sending status information for said particular industrial equipment asset; and
a plurality of display devices at a plurality of locations selectively connectable to said industrial knowledge system to receive said how-to segments of information, at least one of said plurality of said display devices being operable for detecting said low energy transmitter and guiding an operator to said more precise location of said particular industrial equipment asset.
9. The system of claim 8 further comprising said at least one low energy transmitter being configured for transmitting contextual information comprising at least one of a proximity threshold crossed by said user, a loud area, an unauthorized access region, or a dangerous asset.
10. The system of claim 8, further comprising a data server connected to said industrial knowledge system and also being connected to said particular industrial equipment assets, said data server being operable for updating status information for said industrial equipment assets.
11. The system of claim 8, further comprising a job function competency module operable to show whether a particular operator has a competency level to service said particular industrial equipment asset.
12. The system of claim 11, further comprising a heads up display operatively connected to said teaching module and wherein said particular operator can selectively connect to a second operator with a heads up display for additional support for said particular industrial equipment asset.
13. The system of claim 12, wherein said job function competency module is operable to show whether said particular operator has a competency level to service said particular industrial equipment asset with said additional support.
14. The system of claim 11, wherein said job function competency module cooperates with said teaching module to adjust said how-to segments of information based on a competency level of a selected operator.
15. A system to guide industrial maintenance of industrial equipment assets by assisting an operator, comprising:
at least one computer comprising system software and being operable for communication through said computer with a plurality of display devices comprising laptops, tablets, heads up displays (HUD) and computer workstations at a plurality of different locations, said system software comprising a teaching module operable to deliver how-to segments of information comprising visual and written procedures for servicing each of said industrial equipment assets, said system software being configured to determine and store a competency level for said operator of said industrial equipment asset;
at least one low energy near field communicator mounted to a particular industrial equipment asset operable to originate a signal comprising identification and status information of said particular industrial equipment asset; and
an intrinsically safe heads up display (HUD) operable to be worn by said operator, said HUD being operable to receive said identification and status information from said low energy near field communicator, said HUD being operable to display how-to segments of information of industrial maintenance requirements for said particular industrial equipment asset at a location of said particular industrial equipment asset.
16. The system of claim 15, further comprising;
said system software being selectively operable for providing that said how-to segments are adjusted to said competency level of said operator, said how-to segments comprising photos, videos, and documentation.
17. The system of claim 15, wherein said system software is operable for providing a superimposed indicator of an underlying component requiring maintenance in said particular industrial equipment asset for display by said HUD to guide said operator in maintaining said particular industrial equipment asset.
18. The system of claim 17, wherein said superimposed indicator is aligned with said underlying component requiring maintenance in said particular industrial equipment asset when viewed by said operator.
19. The system of claim 17, wherein said superimposed indicator changes after said underlying component is serviced.
20. The system of claim 15, further comprising a hard hat operable for use in industrial areas comprising an intrinsically safe compartment, an extended life battery pack for use with said HUD being mounted in said intrinsically safe compartment.
US14/719,482 2014-05-22 2015-05-22 Interactive Systems for Providing Work Details for a User in Oil and Gas Operations Abandoned US20150339948A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/719,482 US20150339948A1 (en) 2014-05-22 2015-05-22 Interactive Systems for Providing Work Details for a User in Oil and Gas Operations

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201462002030P 2014-05-22 2014-05-22
US14/719,482 US20150339948A1 (en) 2014-05-22 2015-05-22 Interactive Systems for Providing Work Details for a User in Oil and Gas Operations

Publications (1)

Publication Number Publication Date
US20150339948A1 true US20150339948A1 (en) 2015-11-26

Family

ID=54554800

Family Applications (3)

Application Number Title Priority Date Filing Date
US14/719,201 Active US10068173B2 (en) 2014-05-22 2015-05-21 Medical device featuring cladded waveguide
US14/719,482 Abandoned US20150339948A1 (en) 2014-05-22 2015-05-22 Interactive Systems for Providing Work Details for a User in Oil and Gas Operations
US16/047,170 Active US10810496B2 (en) 2014-05-22 2018-07-27 Medical device featuring cladded waveguide

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/719,201 Active US10068173B2 (en) 2014-05-22 2015-05-21 Medical device featuring cladded waveguide

Family Applications After (1)

Application Number Title Priority Date Filing Date
US16/047,170 Active US10810496B2 (en) 2014-05-22 2018-07-27 Medical device featuring cladded waveguide

Country Status (3)

Country Link
US (3) US10068173B2 (en)
EP (2) EP3685734B1 (en)
WO (1) WO2015179708A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019040223A1 (en) * 2017-08-22 2019-02-28 Caterpillar Inc. Method and system for providing notifications related to service information of machine
US10318903B2 (en) 2016-05-06 2019-06-11 General Electric Company Constrained cash computing system to optimally schedule aircraft repair capacity with closed loop dynamic physical state and asset utilization attainment control
US10378318B2 (en) * 2014-06-13 2019-08-13 Halliburton Energy Services, Inc. Monitoring hydrocarbon recovery operations using wearable computer machines
US10645556B2 (en) * 2015-12-17 2020-05-05 Airbus Operations Gmbh Wireless data transmitting device and method for wireless data transmission
US10735889B1 (en) 2015-09-13 2020-08-04 Cecelumen, Llc Methods and apparatus for supporting school operations using wireless signals
US10818194B1 (en) * 2015-09-13 2020-10-27 Cecelumen, Llc Systems and methods for providing access to information, instructions and/or training material
US11231377B2 (en) 2019-06-14 2022-01-25 Northrop Grumman System Corporation Hazardous environment inspection system and related apparatus and methods
US11619698B2 (en) * 2018-12-14 2023-04-04 Kepco Engineering & Construction Company, Inc. Method and terminal for controlling power plant
US11875823B2 (en) * 2020-04-06 2024-01-16 Honeywell International Inc. Hypermedia enabled procedures for industrial workflows on a voice driven platform

Families Citing this family (78)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10154163A1 (en) 2001-11-03 2003-05-22 Advanced Med Tech Device for straightening and stabilizing the spine
US8684577B2 (en) * 2005-05-13 2014-04-01 Invuity, Inc. Body cavity illumination system
US8979931B2 (en) 2006-12-08 2015-03-17 DePuy Synthes Products, LLC Nucleus replacement device and method
CA2701504A1 (en) 2007-10-05 2009-04-09 Synthes Usa, Llc Dilation system and method of using the same
US9289114B2 (en) * 2010-07-30 2016-03-22 Nilesh R. Vasan Disposable, self-contained laryngoscope and method of using same
US9913577B2 (en) 2010-09-28 2018-03-13 Obp Medical Corporation Speculum
US9622779B2 (en) 2011-10-27 2017-04-18 DePuy Synthes Products, Inc. Method and devices for a sub-splenius / supra-levator scapulae surgical access technique
WO2013067179A2 (en) 2011-11-01 2013-05-10 Synthes Usa, Llc Dilation system
US9265490B2 (en) 2012-04-16 2016-02-23 DePuy Synthes Products, Inc. Detachable dilator blade
US9480855B2 (en) 2012-09-26 2016-11-01 DePuy Synthes Products, Inc. NIR/red light for lateral neuroprotection
US10383691B2 (en) 2013-03-13 2019-08-20 The Spectranetics Corporation Last catheter with helical internal lumen
US9283040B2 (en) * 2013-03-13 2016-03-15 The Spectranetics Corporation Device and method of ablative cutting with helical tip
US9456872B2 (en) 2013-03-13 2016-10-04 The Spectranetics Corporation Laser ablation catheter
US20140323811A1 (en) * 2013-04-30 2014-10-30 Invuity, Inc. Methods and apparatus for retracting tissue
US10068173B2 (en) * 2014-05-22 2018-09-04 Invuity, Inc. Medical device featuring cladded waveguide
US10405924B2 (en) 2014-05-30 2019-09-10 The Spectranetics Corporation System and method of ablative cutting and vacuum aspiration through primary orifice and auxiliary side port
US9980737B2 (en) 2014-08-04 2018-05-29 Medos International Sarl Flexible transport auger
US10111712B2 (en) 2014-09-09 2018-10-30 Medos International Sarl Proximal-end securement of a minimally invasive working channel
US10264959B2 (en) 2014-09-09 2019-04-23 Medos International Sarl Proximal-end securement of a minimally invasive working channel
US9924979B2 (en) 2014-09-09 2018-03-27 Medos International Sarl Proximal-end securement of a minimally invasive working channel
US11304776B2 (en) * 2014-10-10 2022-04-19 Sunoptic Technologies, Llc Light carrier and system for mounting same to a surgical instrument
US20160313499A1 (en) * 2014-11-12 2016-10-27 Invuity, Inc. Thermally controlled illumination devices
US9986988B2 (en) * 2014-11-27 2018-06-05 AOD Holdings, LLC Surgical retractor
US9867602B2 (en) 2015-02-05 2018-01-16 Obp Medical Corporation Illuminated surgical retractor
US10420538B2 (en) 2015-02-05 2019-09-24 Obp Medical Corporation Illuminated surgical retractor
US10786264B2 (en) 2015-03-31 2020-09-29 Medos International Sarl Percutaneous disc clearing device
US10939899B2 (en) 2015-06-03 2021-03-09 Obp Medical Corporation End cap assembly for retractor and other medical devices
US10881387B2 (en) 2015-06-03 2021-01-05 Obp Medical Corporation Retractor
CN108348229A (en) 2015-06-03 2018-07-31 Obp医学公司 Retractor
US11439380B2 (en) 2015-09-04 2022-09-13 Medos International Sarl Surgical instrument connectors and related methods
US11672562B2 (en) 2015-09-04 2023-06-13 Medos International Sarl Multi-shield spinal access system
CN113143355A (en) 2015-09-04 2021-07-23 美多斯国际有限公司 Multi-shield spinal access system
US10987129B2 (en) 2015-09-04 2021-04-27 Medos International Sarl Multi-shield spinal access system
US11744447B2 (en) 2015-09-04 2023-09-05 Medos International Surgical visualization systems and related methods
US10264958B2 (en) * 2015-10-19 2019-04-23 University Of New Hampshire Sensor-equipped laryngoscope and system and method for quantifying intubation performance
US10299838B2 (en) 2016-02-05 2019-05-28 Medos International Sarl Method and instruments for interbody fusion and posterior fixation through a single incision
US10722621B2 (en) 2016-07-11 2020-07-28 Obp Medical Corporation Illuminated suction device
WO2018055637A1 (en) * 2016-09-20 2018-03-29 Roy Santosham Light and shadow guided needle positioning system and method
JP1578354S (en) * 2016-10-12 2017-06-05
BR112019008830A2 (en) * 2016-11-02 2019-07-09 Liqid Medical Pty Limited a shunt system, shunt and method for treating an eye disorder
WO2018109580A1 (en) * 2016-12-15 2018-06-21 Novartis Ag Illuminated surgical probe having a variable illumination numerical aperture
EP3554334A2 (en) * 2017-03-29 2019-10-23 Boston Scientific Scimed, Inc. Devices and methods for tissue retraction
US10687793B2 (en) 2017-07-18 2020-06-23 Obp Medical Corporation Minimally invasive no touch (MINT) procedure for harvesting the great saphenous vein (GSV) and venous hydrodissector and retractor for use during the MINT procedure
WO2019036048A2 (en) * 2017-08-17 2019-02-21 Stryker European Holdings I, Llc Lateral access bridges, shims and lighting including rod lighting
US11684353B2 (en) * 2017-09-11 2023-06-27 University Of Florida Research Foundation, Incorporated Tissue-friendly enhanced friction surface for surgical retractors
US10278572B1 (en) 2017-10-19 2019-05-07 Obp Medical Corporation Speculum
US10799229B2 (en) 2018-02-20 2020-10-13 Obp Medical Corporation Illuminated medical devices
US10512519B2 (en) 2018-02-20 2019-12-24 Obp Medical Corporation Illuminated medical devices
WO2019203910A1 (en) * 2018-04-20 2019-10-24 Medtronic Advanced Energy Llc Illumanated electrosurgical devices, systems and methods
US20200015907A1 (en) 2018-07-16 2020-01-16 Ethicon Llc Integration of imaging data
JP2022519213A (en) * 2019-02-08 2022-03-22 リバウンド セラピュティクス コーポレーション Illuminated cannula system
USD911521S1 (en) 2019-02-19 2021-02-23 Obp Medical Corporation Handle for medical devices including surgical retractors
US11013530B2 (en) 2019-03-08 2021-05-25 Medos International Sarl Surface features for device retention
US11241252B2 (en) 2019-03-22 2022-02-08 Medos International Sarl Skin foundation access portal
JP2022525940A (en) 2019-03-27 2022-05-20 パシー メディカル, エルエルシー A kit with luminaires for handheld surgical instruments, holsters for surgical instruments including luminaires, and surgical instruments and luminaires.
US11129727B2 (en) 2019-03-29 2021-09-28 Medos International Sari Inflatable non-distracting intervertebral implants and related methods
US11813026B2 (en) 2019-04-05 2023-11-14 Medos International Sarl Systems, devices, and methods for providing surgical trajectory guidance
EP3955834A4 (en) * 2019-04-17 2023-01-18 Covidien LP Ultrasonic waveguide and blade for ultrasonic surgical instruments and method of manufacturing the same
USD904607S1 (en) 2019-05-07 2020-12-08 Obp Medical Corporation Nasal retractor
CN110275243A (en) * 2019-06-20 2019-09-24 赛尔富电子有限公司 A kind of three face goes out the optical element of light and the shelf lamp with the optical element
ES2922360T3 (en) 2019-08-14 2022-09-13 Synergia Medical Polymeric optical fiber for active implantable medical devices
JP7141540B2 (en) * 2019-08-27 2022-09-22 富士フイルム株式会社 Illumination optical system for endoscope
US11219501B2 (en) 2019-12-30 2022-01-11 Cilag Gmbh International Visualization systems using structured light
US11759283B2 (en) 2019-12-30 2023-09-19 Cilag Gmbh International Surgical systems for generating three dimensional constructs of anatomical organs and coupling identified anatomical structures thereto
US11896442B2 (en) 2019-12-30 2024-02-13 Cilag Gmbh International Surgical systems for proposing and corroborating organ portion removals
US11832996B2 (en) 2019-12-30 2023-12-05 Cilag Gmbh International Analyzing surgical trends by a surgical system
US11284963B2 (en) 2019-12-30 2022-03-29 Cilag Gmbh International Method of using imaging devices in surgery
US11744667B2 (en) 2019-12-30 2023-09-05 Cilag Gmbh International Adaptive visualization by a surgical system
US11648060B2 (en) 2019-12-30 2023-05-16 Cilag Gmbh International Surgical system for overlaying surgical instrument data onto a virtual three dimensional construct of an organ
US11776144B2 (en) 2019-12-30 2023-10-03 Cilag Gmbh International System and method for determining, adjusting, and managing resection margin about a subject tissue
US10959609B1 (en) 2020-01-31 2021-03-30 Obp Medical Corporation Illuminated suction device
US10966702B1 (en) 2020-02-25 2021-04-06 Obp Medical Corporation Illuminated dual-blade retractor
US11644617B1 (en) 2020-09-22 2023-05-09 Apple Inc. Systems having fibers with antireflection coatings
US20220257092A1 (en) * 2021-02-18 2022-08-18 Covidien Lp Laryngoscope blade with glare-reducing features
US11771517B2 (en) 2021-03-12 2023-10-03 Medos International Sarl Camera position indication systems and methods
EP4312831A1 (en) * 2021-03-25 2024-02-07 Lumitex, Inc. Illuminated surgical cannula
US11925401B1 (en) * 2022-09-01 2024-03-12 MediCarbone, Inc. Method of creating biocompatible polymeric resin systems for bone repair and management
JP7401861B1 (en) 2023-02-09 2023-12-20 国立大学法人高知大学 Insert with light source

Citations (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6353313B1 (en) * 1997-09-11 2002-03-05 Comsonics, Inc. Remote, wireless electrical signal measurement device
US20020049566A1 (en) * 1999-03-02 2002-04-25 Wolfgang Friedrich System for operating and observing making use of mobile equipment
US20020191002A1 (en) * 1999-11-09 2002-12-19 Siemens Ag System and method for object-oriented marking and associating information with selected technological components
US20030069648A1 (en) * 2001-09-10 2003-04-10 Barry Douglas System and method for monitoring and managing equipment
US6614408B1 (en) * 1998-03-25 2003-09-02 W. Stephen G. Mann Eye-tap for electronic newsgathering, documentary video, photojournalism, and personal safety
US6633782B1 (en) * 1999-02-22 2003-10-14 Fisher-Rosemount Systems, Inc. Diagnostic expert in a process control system
US6636249B1 (en) * 1998-10-19 2003-10-21 Sony Corporation Information processing apparatus and method, information processing system, and providing medium
US6738040B2 (en) * 2000-08-22 2004-05-18 Siemens Aktiengesellschaft Different display types in a system-controlled, context-dependent information display
US20060241792A1 (en) * 2004-12-22 2006-10-26 Abb Research Ltd. Method to generate a human machine interface
US20060241793A1 (en) * 2005-04-01 2006-10-26 Abb Research Ltd. Human-machine interface for a control system
US20060273918A1 (en) * 2005-06-07 2006-12-07 Ram Satish N System for providing multiple maintenance profiles using wireless communications
US20070097324A1 (en) * 2005-10-27 2007-05-03 Yokogawa Electric Corporation Image information display unit
US20090051502A1 (en) * 2001-11-13 2009-02-26 Ron Craik System and method for storing and retrieving equipment inspection and maintenance data
US20090065578A1 (en) * 2007-09-10 2009-03-12 Fisher-Rosemount Systems, Inc. Location Dependent Control Access in a Process Control System
US7714895B2 (en) * 2002-12-30 2010-05-11 Abb Research Ltd. Interactive and shared augmented reality system and method having local and remote access
US20120025964A1 (en) * 2010-07-27 2012-02-02 Beggs Ryan P Methods and apparatus to detect and warn proximate entities of interest
US20120212484A1 (en) * 2010-02-28 2012-08-23 Osterhout Group, Inc. System and method for display content placement using distance and location information
US20130137076A1 (en) * 2011-11-30 2013-05-30 Kathryn Stone Perez Head-mounted display based education and instruction
US20130174205A1 (en) * 2011-12-29 2013-07-04 Kopin Corporation Wireless Hands-Free Computing Head Mounted Video Eyewear for Local/Remote Diagnosis and Repair
US20130275313A1 (en) * 2013-05-31 2013-10-17 Javid Vahid Apparatus, methods and systems for knowledge based maintenance
US8766794B2 (en) * 2010-07-28 2014-07-01 Fisher-Rosemount Systems, Inc. Handheld field maintenance tool with improved locational awareness functionality
US20140184392A1 (en) * 2012-12-31 2014-07-03 Jason Weiss RFID tag method and apparatus encoded with protective equipment information
US20140241575A1 (en) * 2013-02-27 2014-08-28 Electronics And Telecommunications Research Institute Wearable display-based remote collaboration apparatus and method
US20140262130A1 (en) * 2013-03-15 2014-09-18 Stride Tool, Inc. Smart hvac manifold system
US20150146007A1 (en) * 2013-11-26 2015-05-28 Honeywell International Inc. Maintenance assistant system
US20150287318A1 (en) * 2014-04-04 2015-10-08 Rockwell Automation Technologies, Inc. Industrial-enabled mobile device
US20150327010A1 (en) * 2014-05-07 2015-11-12 Johnson Controls Technology Company Systems and methods for detecting and using equipment location in a building management system
US9389677B2 (en) * 2011-10-24 2016-07-12 Kenleigh C. Hobby Smart helmet
US9446856B1 (en) * 2013-07-31 2016-09-20 Rockwell Collins, Inc. Method and apparatus for maintaining aircraft

Family Cites Families (75)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4562832A (en) * 1984-01-21 1986-01-07 Wilder Joseph R Medical instrument and light pipe illumination assembly
US5002359A (en) * 1990-05-22 1991-03-26 W. L. Gore & Associates, Inc. Buffered insulated optical waveguide fiber cable
US5213092A (en) * 1991-10-31 1993-05-25 Martin Uram Aspirating endoscope
US5248311A (en) 1992-09-14 1993-09-28 Michael Black Fiber-optic probe for soft-tissue laser surgery
US5898810A (en) * 1997-04-04 1999-04-27 Minnesota Mining And Manufacturing Company Illumination waveguide and method for producing same
US20050171408A1 (en) * 1997-07-02 2005-08-04 Parker Jeffery R. Light delivery systems and applications thereof
US7306559B2 (en) * 1997-07-02 2007-12-11 Lumitex, Inc. Illuminated surgical retractor
US6343174B1 (en) 1999-07-30 2002-01-29 Ceramoptec Industries, Inc. Laser delivery system with optical fibers having fluid delivery channels
US20020172478A1 (en) * 2001-05-21 2002-11-21 Sahlin Jennifer Joyce Light transmission techniques
US7223233B2 (en) * 2002-08-02 2007-05-29 Warsaw Orthopedic, Inc. Systems and techniques for illuminating a surgical space
DE60325243D1 (en) * 2002-08-02 2009-01-22 Warsaw Orthopedic Inc SYSTEMS AND TECHNIQUES FOR ILLUMINATING AN OPERATIONAL AREA
US8146400B2 (en) * 2004-04-21 2012-04-03 Acclarent, Inc. Endoscopic methods and devices for transnasal procedures
US20070167682A1 (en) * 2004-04-21 2007-07-19 Acclarent, Inc. Endoscopic methods and devices for transnasal procedures
US20050279354A1 (en) * 2004-06-21 2005-12-22 Harvey Deutsch Structures and Methods for the Joint Delivery of Fluids and Light
US8480566B2 (en) * 2004-09-24 2013-07-09 Vivid Medical, Inc. Solid state illumination for endoscopy
US7390854B2 (en) * 2004-11-05 2008-06-24 E. I. Dupont De Nemours And Company Low shrinkage, low optical absorbance, low refractive index adhesive composition
JP4423421B2 (en) * 2004-12-01 2010-03-03 国立大学法人浜松医科大学 Evanescent catheter system
US9675235B2 (en) * 2005-03-21 2017-06-13 Jonas V. Lieponis Multi-purpose surgical instrument with removable component
US7842027B2 (en) * 2005-03-21 2010-11-30 Lieponis Jonas V Multi-purpose surgical instrument with integral optical system
US20060211918A1 (en) * 2005-03-21 2006-09-21 Lieponis Jonas V Surgical instrument with integral optical system
US20060224045A1 (en) * 2005-03-31 2006-10-05 Depuy Spine, Inc. Integrated access device and light source for surgical procedures
US7510524B2 (en) 2005-04-04 2009-03-31 Invuity, Inc. Optical waveguide sheath
US9005115B2 (en) * 2005-04-04 2015-04-14 Invuity, Inc. Illuminated telescoping cannula
US7933482B2 (en) * 2005-04-27 2011-04-26 University Of Maryland, College Park Optical fiber probe tips and methods for fabricating same
US20070060795A1 (en) * 2005-09-14 2007-03-15 Spotlight Surgical, Inc. Lighted surgical retractors with LED illumination light engines
US7874982B2 (en) * 2005-11-02 2011-01-25 Depuy Spine, Inc. Illuminated surgical access system including a surgical access device and coupled light emitter
US8409088B2 (en) 2006-01-18 2013-04-02 Invuity, Inc. Retractor illumination system
US8012089B2 (en) * 2006-05-22 2011-09-06 Ardeshir Bayat Disposable expandable cordless lighted retractor
US8430813B2 (en) * 2006-05-26 2013-04-30 Depuy Spine, Inc. Illuminated surgical access system including a surgical access device and integrated light emitter
US8047987B2 (en) * 2006-05-26 2011-11-01 Invuity, Inc. Blade insert illuminator
US7686492B2 (en) * 2006-06-13 2010-03-30 Invuity, Inc. Film illumination system
US20080255545A1 (en) * 2007-04-10 2008-10-16 Mansfield John M Apparatus and method for treating the inside of an eye
US7991257B1 (en) * 2007-05-16 2011-08-02 Fusion Optix, Inc. Method of manufacturing an optical composite
US8475364B2 (en) * 2007-07-02 2013-07-02 Frederic Supiez Endotracheal intubation system and intubation procedure
US7469082B1 (en) * 2007-09-28 2008-12-23 The Aerospace Corporation High power optical fiber laser array holographic couplers
US8641609B2 (en) * 2007-10-23 2014-02-04 Zimmer Spine, Inc. Surgical access system and method of using the same
US8088066B2 (en) * 2007-10-24 2012-01-03 Invuity, Inc. Blade insert illuminator
WO2009103070A1 (en) * 2008-02-14 2009-08-20 The Curators Of The University Of Missouri Ultra-low refractive index high surface area nanoparticulate films and nanoparticles
WO2009111610A1 (en) * 2008-03-05 2009-09-11 University Of Washington Waveguides and devices for enhanced third order nonlinearities in polymer-silicon systems
WO2009116969A1 (en) 2008-03-20 2009-09-24 Invuity, Inc. Illuminated cannula
US8000576B2 (en) * 2008-07-24 2011-08-16 Corning Incorporated Double-clad optical fibers and devices with double-clad optical fibers
US8317693B2 (en) * 2008-08-13 2012-11-27 Invuity, Inc. Cyclo olefin polymer and copolymer medical devices
US9282878B2 (en) * 2008-08-13 2016-03-15 Invuity, Inc. Cyclo olefin polymer and copolymer medical devices
US8905610B2 (en) 2009-01-26 2014-12-09 Flex Lighting Ii, Llc Light emitting device comprising a lightguide film
KR101096401B1 (en) * 2009-04-27 2011-12-21 국립암센터 Surgical instrument
US8795162B2 (en) * 2009-11-10 2014-08-05 Invuity, Inc. Illuminated suction apparatus
US8292805B2 (en) * 2009-11-10 2012-10-23 Invuity, Inc. Illuminated suction apparatus
WO2011075442A1 (en) * 2009-12-15 2011-06-23 Omniguide, Inc. Two-part surgical waveguide
US8948560B1 (en) * 2010-03-15 2015-02-03 Cirrex Systems, Llc Elevating numerical aperture of optical systems
US9289114B2 (en) * 2010-07-30 2016-03-22 Nilesh R. Vasan Disposable, self-contained laryngoscope and method of using same
US9011323B2 (en) * 2010-10-08 2015-04-21 Invuity, Inc. Method and apparatus for soft tissue retraction
DE102010050933A1 (en) * 2010-11-11 2012-05-16 Karl Storz Gmbh & Co. Kg Endoscope with swiveling viewing direction
KR102161945B1 (en) * 2010-12-16 2020-10-21 인뷰이티 인코퍼레이티드 Illuminated suction apparatus
EP2677922A1 (en) * 2011-02-21 2014-01-01 Parmar, Jaywant Philip Optical endoluminal far-field microscopic imaging catheter
JP6224593B2 (en) * 2011-09-23 2017-11-01 インブイティ・インコーポレイテッド Illuminated modular soft tissue retractor
EP3020425B1 (en) * 2011-11-03 2017-08-09 Porex Corporation Hydrophobic porous non mechanical valve for medical suction device
WO2013095981A1 (en) * 2011-12-19 2013-06-27 Corning Incorporated Uniform uv efficient light diffusing fiber
US8899809B2 (en) * 2012-01-30 2014-12-02 Invuity, Inc. Illuminated clip and methods of use
US20130197313A1 (en) * 2012-01-31 2013-08-01 Shaw P. Wan Surgical retractor with light
WO2013177324A2 (en) * 2012-05-25 2013-11-28 Invuity, Inc. Actuatable retractor
AU2013317584A1 (en) * 2012-09-24 2015-04-02 Invuity, Inc. Methods and apparatus for controlling optical properties of light
US20140121467A1 (en) * 2012-10-31 2014-05-01 Invuity, Inc. Methods and apparatus for simultaneous retraction and distraction of bone and soft tissue
CA2881740A1 (en) * 2012-11-01 2014-05-08 Alcon Research Ltd. Illuminated vitrectomy cutter with adjustable illumination aperture
EP2980105B1 (en) * 2013-03-27 2019-10-02 AGC Inc. Terminal group conversion method and terminal stabilizing method
US20140323811A1 (en) * 2013-04-30 2014-10-30 Invuity, Inc. Methods and apparatus for retracting tissue
US9618672B2 (en) * 2013-05-31 2017-04-11 Corning Incorporated Uniform illumination light diffusing fiber device
AU2014285081A1 (en) * 2013-07-03 2016-02-25 Uvlrx Therapeutics Inc. Sheathed optical fiber
KR102313660B1 (en) 2013-09-16 2021-10-18 인뷰이티 인코퍼레이티드 Thermally controlled illumination devices
US10068173B2 (en) * 2014-05-22 2018-09-04 Invuity, Inc. Medical device featuring cladded waveguide
US10828050B2 (en) * 2014-07-28 2020-11-10 Shaw P. Wan Suction evacuation device
KR20170047277A (en) * 2014-08-28 2017-05-04 인뷰이티 인코퍼레이티드 Modular surgical instrument
US20160313499A1 (en) * 2014-11-12 2016-10-27 Invuity, Inc. Thermally controlled illumination devices
US9482818B2 (en) * 2015-02-23 2016-11-01 Cisco Technology, Inc. Optically coupling waveguides
EP3291742A4 (en) * 2015-04-24 2018-08-15 Invuity, Inc. Surgical instrument compatible with operating room equipment
CN109219381A (en) * 2016-06-13 2019-01-15 奥林巴斯株式会社 Medical device

Patent Citations (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6353313B1 (en) * 1997-09-11 2002-03-05 Comsonics, Inc. Remote, wireless electrical signal measurement device
US6614408B1 (en) * 1998-03-25 2003-09-02 W. Stephen G. Mann Eye-tap for electronic newsgathering, documentary video, photojournalism, and personal safety
US6636249B1 (en) * 1998-10-19 2003-10-21 Sony Corporation Information processing apparatus and method, information processing system, and providing medium
US6633782B1 (en) * 1999-02-22 2003-10-14 Fisher-Rosemount Systems, Inc. Diagnostic expert in a process control system
US20020049566A1 (en) * 1999-03-02 2002-04-25 Wolfgang Friedrich System for operating and observing making use of mobile equipment
US20020191002A1 (en) * 1999-11-09 2002-12-19 Siemens Ag System and method for object-oriented marking and associating information with selected technological components
US6738040B2 (en) * 2000-08-22 2004-05-18 Siemens Aktiengesellschaft Different display types in a system-controlled, context-dependent information display
US20030069648A1 (en) * 2001-09-10 2003-04-10 Barry Douglas System and method for monitoring and managing equipment
US20090051502A1 (en) * 2001-11-13 2009-02-26 Ron Craik System and method for storing and retrieving equipment inspection and maintenance data
US7714895B2 (en) * 2002-12-30 2010-05-11 Abb Research Ltd. Interactive and shared augmented reality system and method having local and remote access
US20060241792A1 (en) * 2004-12-22 2006-10-26 Abb Research Ltd. Method to generate a human machine interface
US20060241793A1 (en) * 2005-04-01 2006-10-26 Abb Research Ltd. Human-machine interface for a control system
US20060273918A1 (en) * 2005-06-07 2006-12-07 Ram Satish N System for providing multiple maintenance profiles using wireless communications
US20070097324A1 (en) * 2005-10-27 2007-05-03 Yokogawa Electric Corporation Image information display unit
US20090065578A1 (en) * 2007-09-10 2009-03-12 Fisher-Rosemount Systems, Inc. Location Dependent Control Access in a Process Control System
US20120212484A1 (en) * 2010-02-28 2012-08-23 Osterhout Group, Inc. System and method for display content placement using distance and location information
US20120025964A1 (en) * 2010-07-27 2012-02-02 Beggs Ryan P Methods and apparatus to detect and warn proximate entities of interest
US8766794B2 (en) * 2010-07-28 2014-07-01 Fisher-Rosemount Systems, Inc. Handheld field maintenance tool with improved locational awareness functionality
US9389677B2 (en) * 2011-10-24 2016-07-12 Kenleigh C. Hobby Smart helmet
US20130137076A1 (en) * 2011-11-30 2013-05-30 Kathryn Stone Perez Head-mounted display based education and instruction
US20130174205A1 (en) * 2011-12-29 2013-07-04 Kopin Corporation Wireless Hands-Free Computing Head Mounted Video Eyewear for Local/Remote Diagnosis and Repair
US20140184392A1 (en) * 2012-12-31 2014-07-03 Jason Weiss RFID tag method and apparatus encoded with protective equipment information
US20140241575A1 (en) * 2013-02-27 2014-08-28 Electronics And Telecommunications Research Institute Wearable display-based remote collaboration apparatus and method
US20140262130A1 (en) * 2013-03-15 2014-09-18 Stride Tool, Inc. Smart hvac manifold system
US20130275313A1 (en) * 2013-05-31 2013-10-17 Javid Vahid Apparatus, methods and systems for knowledge based maintenance
US9446856B1 (en) * 2013-07-31 2016-09-20 Rockwell Collins, Inc. Method and apparatus for maintaining aircraft
US20150146007A1 (en) * 2013-11-26 2015-05-28 Honeywell International Inc. Maintenance assistant system
US20150287318A1 (en) * 2014-04-04 2015-10-08 Rockwell Automation Technologies, Inc. Industrial-enabled mobile device
US20150327010A1 (en) * 2014-05-07 2015-11-12 Johnson Controls Technology Company Systems and methods for detecting and using equipment location in a building management system

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10378318B2 (en) * 2014-06-13 2019-08-13 Halliburton Energy Services, Inc. Monitoring hydrocarbon recovery operations using wearable computer machines
US10735889B1 (en) 2015-09-13 2020-08-04 Cecelumen, Llc Methods and apparatus for supporting school operations using wireless signals
US10818194B1 (en) * 2015-09-13 2020-10-27 Cecelumen, Llc Systems and methods for providing access to information, instructions and/or training material
US10645556B2 (en) * 2015-12-17 2020-05-05 Airbus Operations Gmbh Wireless data transmitting device and method for wireless data transmission
US10318903B2 (en) 2016-05-06 2019-06-11 General Electric Company Constrained cash computing system to optimally schedule aircraft repair capacity with closed loop dynamic physical state and asset utilization attainment control
US10318904B2 (en) 2016-05-06 2019-06-11 General Electric Company Computing system to control the use of physical state attainment of assets to meet temporal performance criteria
WO2019040223A1 (en) * 2017-08-22 2019-02-28 Caterpillar Inc. Method and system for providing notifications related to service information of machine
US10482402B2 (en) 2017-08-22 2019-11-19 Caterpillar Inc. Method and system for providing notifications related to service information of machine
US11619698B2 (en) * 2018-12-14 2023-04-04 Kepco Engineering & Construction Company, Inc. Method and terminal for controlling power plant
US11231377B2 (en) 2019-06-14 2022-01-25 Northrop Grumman System Corporation Hazardous environment inspection system and related apparatus and methods
US11875823B2 (en) * 2020-04-06 2024-01-16 Honeywell International Inc. Hypermedia enabled procedures for industrial workflows on a voice driven platform
US11942118B2 (en) 2020-04-06 2024-03-26 Honeywell International Inc. Hypermedia enabled procedures for industrial workflows on a voice driven platform

Also Published As

Publication number Publication date
EP3685734A1 (en) 2020-07-29
EP3145385A1 (en) 2017-03-29
EP3145385A4 (en) 2018-02-14
US10810496B2 (en) 2020-10-20
WO2015179708A1 (en) 2015-11-26
US10068173B2 (en) 2018-09-04
US20160015467A1 (en) 2016-01-21
US20180336474A1 (en) 2018-11-22
EP3685734B1 (en) 2022-03-09

Similar Documents

Publication Publication Date Title
US20150339948A1 (en) Interactive Systems for Providing Work Details for a User in Oil and Gas Operations
JP7232539B2 (en) Methods and systems for providing and receiving information for field risk management
CA2776434A1 (en) Methods, apparatus and systems for chronicling the activities of field technicians
US20170011254A1 (en) Augmented reality based component replacement and maintenance
US20100010883A1 (en) Methods and apparatus for facilitating a quality assessment of a field service operation based on multiple quality assessment criteria
US10896389B2 (en) Workflow method and system for student retention management
US20210012266A1 (en) Augmented management system and method
US20140330604A1 (en) Operator assistance system and method
US20120233083A1 (en) Method and System for Automatic Alert Generation in Retention Management System
US20120233108A1 (en) System and Method for Determining Risk of Student Attrition
US10915754B2 (en) System and method for use of augmented reality in outfitting a dynamic structural space
US8878686B2 (en) Maintainer spotlighting
CN107219825B (en) Method for providing inspection instruction, job site management system, and storage medium
Medema et al. Guidance for Deployment of Mobile Technologies for Nuclear Power Plant Field Workers
CA2892436A1 (en) Interactive systems for providing work details for a user in oil and gas operations
US11392866B2 (en) Devices, systems and methods for managing technician logistics
Pray et al. Integration of wearable technology for inspection tasks
St Germain et al. Development of Improved Graphical Displays for an Advanced Outage Control Center, Employing Human Factors Principles for Outage Schedule Management
US20190188638A1 (en) Methods and systems for improving vehicle searches
US20240128115A1 (en) Resource management with time and expense tracking
Chung et al. The application of RFID monitoring technology to patrol management system in petrochemical industry
JP2020091530A (en) Facility management system
Carter Mine Safety: Working within the system
AU2017100560A4 (en) Methods and Systems for Providing and Receiving Information For Risk Management in the Field
GB2527778A (en) Combined data exchange and emergency alarm apparatus and method of use

Legal Events

Date Code Title Description
AS Assignment

Owner name: XTREME DRILLING AND COIL SERVICES, CANADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WOOD, THOMAS JAMES;ROACHELL, ALAN;TRUAX, DAVID;AND OTHERS;SIGNING DATES FROM 20150608 TO 20150724;REEL/FRAME:036183/0174

AS Assignment

Owner name: ROWAN, MIKE, CANADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:XTREME DRILLING AND COIL SERVICES;REEL/FRAME:036212/0011

Effective date: 20150728

Owner name: WOOD, THOMAS JAMES, CANADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:XTREME DRILLING AND COIL SERVICES;REEL/FRAME:036212/0011

Effective date: 20150728

AS Assignment

Owner name: 3RD-EYE TECHNOLOGIES, INC., CANADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WOOD, THOMAS JAMES;ROWAN, MIKE;REEL/FRAME:036226/0895

Effective date: 20150729

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION