US 9,685,099 B2Grant
System for characterizing manual welding operations
Issue Date:2017-06-20
•30 Claims
•12 Drawing Sheets
Abstract
A system for characterizing manual welding exercises and providing valuable training to welders that includes components for generating, capturing, and processing data. The data generating component further includes a fixture, workpiece, at least one calibration devices each having at least two point markers integral therewith, and a welding tool. The data capturing component further includes an imaging system for capturing images of the point markers and the data processing component is operative to receive information from the data capturing component and perform various position and orientation calculations.
Metadata
Assignee
- Lincoln Global, Inc.
Inventors
- Paul Christopher Boulware
- Christopher C. Conrardy
- Douglas A. Clark
- M. William Forquer
Application Information
Application Number:US 15/077,481
Filing Date:2016-03-22
Priority Date:2009-07-08
Art Unit:3715
Classifications
IPC:
G09B19/00G09B19/24B23K9/095B23K9/10G09B5/02
Field of Search:
G09B 19/24G09B 9/00B23K 9/32B23K 9/0956B23K 9/0953G05B 2219/45135
Patent Drawings (12 sheets)
Description
Cross-Reference to Related Applications
[0001] The present application is being filed as a continuation of U.S. patent application Ser. No. 14/293,700 filed on Jun. 2, 2014 and entitled SYSTEM AND METHOD FOR MANUAL WELDER TRAINING, which is a continuation-in-part of U.S. patent application Ser. No. 13/543,240 filed on Jul. 6, 2012 and entitled SYSTEM FOR CHARACTERIZING MANUAL WELDING OPERATIONS, now U.S. Pat. No. 9,221,117 issued on Dec. 29, 2015, which is a continuation-in-part of both U.S. patent application Ser. No. 12/966,570 filed on Dec. 13, 2010 and entitled WELDING TRAINING SYSTEM, now U.S. Pat. No. 9,230,449 issued on Jan. 5, 2016 (which itself is a continuation-in-part of U.S. patent application Ser. No. 12/499,687 filed on Jul. 8, 2009 and entitled METHOD AND SYSTEM FOR MONITORING AND CHARACTERIZING THE CREATION OF A MANUAL WELD, now abandoned) and U.S. patent application Ser. No. 12/499,687 filed on Jul. 8, 2009 and entitled METHOD AND SYSTEM FOR MONITORING AND CHARACTERIZING THE CREATION OF A MANUAL WELD, now abandoned, the entire disclosures of which are incorporated herein by reference. The present application is also being filed as a continuation of U.S. patent application Ser. No. 14/293,826 filed on Jun. 2, 2014 and entitled SYSTEM AND METHOD MONITORING AND CHARACTERIZING MANUAL WELDING OPERATIONS, which is a continuation-in-part of U.S. patent application Ser. No. 13/543,240 filed on Jul. 6, 2012 and entitled SYSTEM FOR CHARACTERIZING MANUAL WELDING OPERATIONS, now U.S. Pat. No. 9,221,117 issued on Dec. 29, 2015, which is a continuation-in-part of both U.S. patent application Ser. No. 12/966,570 filed on Dec. 13, 2010 and entitled WELDING TRAINING SYSTEM, now U.S. Pat. No. 9,230,449 issued on Jan. 5, 2016 (which itself is a continuation-in-part of U.S. patent application Ser. No. 12/499,687 filed on Jul. 8, 2009 and entitled METHOD AND SYSTEM FOR MONITORING AND CHARACTERIZING THE CREATION OF A MANUAL WELD, now abandoned) and U.S. patent application Ser. No. 12/499,687 filed on Jul. 8, 2009 and entitled METHOD AND SYSTEM FOR MONITORING AND CHARACTERIZING THE CREATION OF A MANUAL WELD, now abandoned, the entire disclosures of which are incorporated herein by reference.
Background of the Invention
[0002] The described invention relates in general to a system for characterizing manual welding operations, and more specifically to a system for providing useful information to a welding trainee by capturing, processing, and presenting in a viewable format, data generated by the welding trainee in manually executing an actual weld in real time.
[0003] The manufacturing industry's desire for efficient and economical welder training has been a well documented topic over the past decade as the realization of a severe shortage of skilled welders is becoming alarmingly evident in today's factories, shipyards, and construction sites. A rapidly retiring workforce, combined with the slow pace of traditional instructor-based welder training has been the impetus for the development of more effective training technologies. Innovations which allow for the accelerated training of the manual dexterity skills specific to welding, along with the expeditious indoctrination of arc welding fundamentals are becoming a necessity. The characterization and training system disclosed herein addresses this vital need for improved welder training and enables the monitoring of manual welding processes to ensure the processes are within permissible limits necessary to meet industry-wide quality requirements. To date, the majority of welding processes are performed manually, yet the field is lacking practical commercially available tools to track the performance of these manual processes. Thus, there is an ongoing need for an effective system for training welders to properly execute various types of welds under various conditions.
Summary of the Invention
[0004] The following provides a summary of certain exemplary embodiments of the present invention. This summary is not an extensive overview and is not intended to identify key or critical aspects or elements of the present invention or to delineate its scope.
[0005] In accordance with one aspect of the present invention, a system for characterizing manual and/or semiautomatic welding operations and exercises is provided. This system includes a data generating component; a data capturing component; and a data processing component. The data generating component further includes a fixture, wherein the geometric characteristics of the fixture are predetermined; a workpiece adapted to be mounted on the fixture, wherein the workpiece includes at least one joint to be welded, and wherein the vector extending along the joint to be welded defines an operation path; at least one calibration device, wherein each calibration device further includes at least two point markers integral therewith, and wherein the geometric relationship between the point markers and the operation path is predetermined; and a welding tool, wherein the welding tool is operative to form a weld at the joint to be welded, wherein the welding tool defines a tool point and a tool vector, and wherein the welding tool further includes a target attached to the welding tool, wherein the target further includes a plurality of point markers mounted thereon in a predetermined pattern, and wherein the predetermined pattern of point markers is operative to define a rigid body. The data capturing component further includes an imaging system for capturing images of the point markers. The data processing component is operative to receive information from the data capturing component and then calculate the position and orientation of the operation path relative to the three-dimensional space viewable by the imaging system; the position of the tool point and orientation of the tool vector relative to the rigid body; and the position of the tool point and orientation of the tool vector relative to the operation path.
[0006] In accordance with another aspect of the present invention, a system for characterizing manual and/or semiautomatic welding operations and exercises is also provided. This system includes a data generating component; a data capturing component; and a data processing component. The data generating component further includes a fixture, wherein the geometric characteristics of the fixture are predetermined; a workpiece adapted to be mounted on the fixture, wherein the workpiece includes at least one joint to be welded, and wherein the vector extending along the joint to be welded defines an operation path; at least one calibration device, wherein each calibration device further includes at least two point markers integral therewith, and wherein the geometric relationship between the point markers and the operation path is predetermined; and a welding tool, wherein the welding tool is operative to form a weld at the joint to be welded, wherein the welding tool defines a tool point and a tool vector, and wherein the welding tool further includes a target attached to the welding tool, wherein the target further includes a plurality of point markers mounted thereon in a predetermined pattern, and wherein the predetermined pattern of point markers is operative to define a rigid body. The data capturing component further includes an imaging system for capturing images of the point markers and the imaging system further includes a plurality of digital cameras. At least one band-pass filter is incorporated into the optical sequence for each of the plurality of digital cameras for permitting light from only the wavelengths which are reflected or emitted from the point markers for improving image signal-to-noise ratio. The data processing component is operative to receive information from the data capturing component and then calculate the position and orientation of the operation path relative to the three-dimensional space viewable by the imaging system; the position of the tool point and orientation of the tool vector relative to the rigid body; and the position of the tool point and orientation of the tool vector relative to the operation path.
[0007] Additional features and aspects of the present invention will become apparent to those of ordinary skill in the art upon reading and understanding the following detailed description of the exemplary embodiments. As will be appreciated by the skilled artisan, further embodiments of the invention are possible without departing from the scope and spirit of the invention. Accordingly, the drawings and associated descriptions are to be regarded as illustrative and not restrictive in nature.
Brief Description of the Drawings
[0008] The accompanying drawings, which are incorporated into and form a part of the specification, schematically illustrate one or more exemplary embodiments of the invention and, together with the general description given above and detailed description given below, serve to explain the principles of the invention, and wherein:
[0009] FIG. 1 is a flow chart illustrating the flow of information through the data processing and visualization component of an exemplary embodiment of the present invention;
[0010] FIG. 2 provides an isometric view of a portable or semi-portable system for characterizing manual welding operations, in accordance with an exemplary embodiment of the present invention;
[0011] FIG. 3 provides an isometric view of the flat assembly of the system of FIG. 2 ;
[0012] FIG. 4 provides an isometric view of the horizontal assembly of the system of FIG. 2 ;
[0013] FIG. 5 provides an isometric view of the vertical assembly of the system of FIG. 2 ;
[0014] FIG. 6 illustrates the placement of two point markers on the flat assembly of FIG. 2 ;
[0015] FIG. 7 illustrates an exemplary workpiece operation path;
[0016] FIG. 8 illustrates the placement of two active or passive point markers on an exemplary workpiece for determining a workpiece operation path;
[0017] FIG. 9 is a flowchart detailing the process steps involved in an exemplary embodiment of a first calibration component of the present invention;
[0018] FIG. 10 illustrates the welding tool of an exemplary embodiment of this invention showing the placement of the point markers used to define the rigid body;
[0019] FIG. 11 illustrates the welding tool of an exemplary embodiment of this invention showing the placement of the point markers used to define the tool vector and the rigid body; and
[0020] FIG. 12 is a flowchart detailing the process steps involved in an exemplary embodiment of a second calibration component of the present invention.
Detailed Description of the Invention
[0021] Exemplary embodiments of the present invention are now described with reference to the Figures. Reference numerals are used throughout the detailed description to refer to the various elements and structures. In other instances, well-known structures and devices are shown in block diagram form for purposes of simplifying the description. Although the following detailed description contains many specifics for the purposes of illustration, a person of ordinary skill in the art will appreciate that many variations and alterations to the following details are within the scope of the invention. Accordingly, the following embodiments of the invention are set forth without any loss of generality to, and without imposing limitations upon, the claimed invention.
[0022] The present invention relates to an advanced system for observing and characterizing manual welding exercises and operations. This system is particularly useful for welding instruction and welder training that provides an affordable tool for measuring manual welding technique and comparing that technique with established procedures. The training applications of this invention include: (i) screening applicant skill levels; (ii) assessing trainee progress over time; (iii) providing real-time coaching to reduce training time and costs; and (iv) periodically re-testing welder skill levels with quantifiable results. Processing monitoring and quality control applications include: (i) identification of deviations from preferred conditions in real time; (ii) documenting and tracking compliance with procedures over time; (iii) capturing in-process data for statistical process control purposes (e.g., heat input measurements); and (iv) identifying welders needing additional training. The system of the present invention provides the unique benefit of enabling the determination of compliance with various accepted welding procedures.
[0023] The present invention, in various exemplary embodiments, measures torch motion and gathers process data during welding exercises using a single or multiple camera tracking system based on point cloud image analysis. This invention is applicable to a wide range of processes including, but not necessarily limited to, GMAW, FCAW, SMAW, GTAW, and cutting. The invention is expandable to a range of work-piece configurations, including large sizes, various joint type, pipe, plate, and complex shapes. Measured parameters include work angle, travel angle, tool standoff, travel speed, bead placement, weave, voltage, current, wire feed speed, and arc length. The training component of the present invention may be pre-populated with specific welding procedures or it may be customized by an instructor. Data is automatically saved and recorded, a post-weld analysis scores performance, and progress is tracked over time. This system may be used throughout an entire welding training program and may include both in-helmet and on-screen feedback. With reference now to the Figures, one or more specific embodiments of this invention shall be described in greater detail.
[0024] As shown in FIG. 1 , in an exemplary embodiment of the present invention, the basic flow of information through data generating component 100, data capturing component 200, and data processing (and visualization) component 300 of weld characterization system 10 occurs in six basic steps: (1) image capture 110; (2) image processing 112; (3) input of arc weld data 210, such as known or preferred weld parameters; (4) data processing 212; (5) data storage 214; and (5) data display 310. Image capture step 110 includes capturing images of target 98 (which typically includes at least two point markers located in a fixed geometric relationship to one another) with one or more off-the shelf high-speed-vision cameras, where the output aspect typically includes creating of an image file at over 100 frames per second. The input aspect of image processing step 112 includes frame-by-frame point cloud analysis of a rigid body that includes three or more point markets (i.e., the calibrated target). Upon recognition of a known rigid body, position and orientation are calculated relative to the camera origin and the “trained” rigid body orientation. Capturing and comparing the images from two or more cameras allows for a substantially accurate determination of the rigid body position and orientation in three-dimensional space. Images are typically processed at a rate of more than 10 times per second. The output aspect of image processing step 112 includes creation of a data array that includes x-axis, y-axis, and z-axis positional data and roll, pitch, and yaw orientation data, as well as time stamps and software flags. The text file may be streamed or sent at a desired frequency. The input aspect of data processing step 212 includes raw positional and orientation data typically requested at a predetermined rate, while the output aspect includes transforming this raw data into useful welding parameters with algorithms specific to a selected process and joint type. The input aspect of data storage step 214 includes storing welding trial data as a *.dat file, while the output aspect includes saving the data for review and tracking, saving the date for review on a monitor at a later time, and/or reviewing the progress of the student at a later time. Student progress may include total practice time, total arc time, total arc starts, and individual parameter-specific performance over time. The input aspect of data display step 310 includes welding trial data that further includes work angle, travel angle, tool standoff, travel speed, bead placement, weave, voltage, current, wire-feed speed, while the output aspect involves data that may viewed on a monitor, in-helmet display, heads-up display, or combinations thereof, wherein parameters are plotted on a time-based axis and compared to upper and lower thresholds or preferred variations, such as those trained by recording the motions of an expert welder. Current and voltage may be measured in conjunction with travel speed to determine heat input and the welding process parameters may be used to estimate arc length. Position data may be transformed into weld start position, weld stop position, weld length, weld sequence, welding progression, or combinations thereof and current and voltage may be measured in conjunction with travel speed to determine heat input.
[0025] FIGS. 2-5 provide illustrative views of weld characterization system 10 in accordance with an exemplary embodiment the present invention. As shown in FIG. 2 , portable training stand 20 includes a substantially flat base 22 for contact with a floor or other horizontal substrate, rigid vertical support column 24, camera or imaging device support 26, and rack and pinion assembly 31 for adjusting the height of imaging device support 26. In most embodiments, weld characterization system 10 is intended to be portable or at least moveable from one location to another, therefore the overall footprint of base 22 is relatively small to permit maximum flexibility with regard to installation and use. As shown in FIG. 2-6 , weld characterization system 10 may be used for training exercises that include flat, horizontally or vertically oriented workpieces. In the exemplary embodiments shown in the Figures, training stand 20 is depicted as a unitary or integrated structure that is capable of supporting the other components of system. In other embodiments, stand 20 is absent and the various components of the system are supported by whatever suitable structural or supportive means may be available. Thus, within the context of this invention, “stand” 20 is defined as any single structure or, alternately, multiple structures that are capable of supporting the components of weld characterization system 10.
[0026] With to FIGS. 2-3 , certain welding exercises will utilize a flat assembly 30, which is slidably attached to vertical support column 24 by collar 34, which slides upward or downward on support column 24. Collar 34 is further supported on column 24 by rack and pinion 31, which includes shaft 32 for moving rack and pinion assembly 31 upward or downward on support column 24. Flat assembly 30 includes training platform 38, which is supported by one or more brackets (not visible). In some embodiments, a shield 42 is attached to training platform 38 for protecting the surface of support column 24 from heat damage. Training platform 38 further includes at least one clamp 44 for securing weld position-specific fixture/jig 46 to the surface of the training platform. The structural configuration or general characteristics of weld position-specific jig 46 are variable based on the type of weld process that is the subject of a particular welding exercise, and in FIGS. 2-3 , fixture 46 is configured for a fillet weld exercise. In the exemplary embodiment shown in FIGS. 2-3 , first 48 and second 50 structural components of weld position-specific fixture 46 are set at right angles to one another. Position-specific fixture 46 may include one or more pegs 47 for facilitating proper placement of a weld coupon on the fixture. The characteristics of any weld coupon (workpiece) 54 used with system 10 are variable based on the type of manual welding process that is the subject of a particular training exercise and in the exemplary embodiment shown in the FIGS. 7-8 , first 56 and second 58 portions of weld coupon 54 are also set at right angles to one another. With reference to FIGS. 4-5 , certain other welding exercises will utilize a horizontal assembly 30 (see FIG. 4 ) or a vertical assembly 30 (see FIG. 5 ). In FIG. 4 , horizontal assembly 30 supports butt fixture 46, which holds workpiece 54 in the proper position for a butt weld exercise. In FIG. 5 , vertical assembly 30 supports vertical fixture 46, which holds workpiece 54 in the proper position for a lap weld exercise.
[0027] Data processing component 300 of the present invention typically includes at least one computer for receiving and analyzing information captured by the data capturing component 200, which itself includes at least one digital camera contained in a protective housing. During operation of weld characterization system 10, this computer is typically running software that includes a training regimen module, an image processing and rigid body analysis module, and a data processing module. The training regimen module includes a variety of weld types and a series of acceptable welding process parameters associated with creating each weld type. Any number of known or AWS weld joint types and the acceptable parameters associated with these weld joint types may be included in the training regimen module, which is accessed and configured by a course instructor prior to the beginning of a training exercise. The weld process and/or type selected by the instructor determine which weld process-specific fixture, calibration device, and weld coupon are used for any given training exercise. The object recognition module is operative to train the system to recognize a known rigid body target 98 (which includes two or more point markers) and for then to use target 98 to calculate positional and orientation data for welding gun 90 as an actual manual weld is completed by a trainee. The data processing module compares the information in the training regimen module to the information processed by the object recognition module and outputs the comparative data to a display device such as a monitor or head-up display. The monitor allows the trainee to visualize the processed data in real time and the visualized data is operative to provide the trainee with useful feedback regarding the characteristics and quality of the weld. The visual interface of weld characterization system 10 may include a variety of features related to the input of information, login, setup, calibration, practice, analysis, and progress tracking. The analysis screen typically displays the welding parameters found in the training regimen module, including (but not limited to) work angle, travel angle, tool standoff, travel speed, bead placement, weave, voltage, current, wire-feed speed, and arc length. Multiple display variations are possible with the present invention.
[0028] In most, if not all instances, weld characterization system 10 will be subjected to a series of calibration steps/processes prior to use. Some of the aspects of the system calibration will typically be performed by the manufacturer of system 10 prior to delivery to a customer and other aspects of the system calibration will typically be performed by the user of weld characterization system 10 prior to any welding training exercises. System calibration typically involves two related and integral calibration processes: (i) determining the three-dimensional position and orientation of the operation path to be created on a workpiece for each joint/position combination to be used in various welding training exercises; and (ii) determining the three-dimensional position and orientation of the welding tool by calculating the relationship between a plurality of reflective (passive) or light emitting (active) point markers located on target 98 and at least two key points represented by point markers located on the welding tool 90.
[0029] The first calibration aspect of this invention typically involves the calibration of the welding operation with respect to the global coordinate system, i.e., relative to the other structural components of weld characterization system 10 and the three-dimensional space occupied thereby. Prior to tracking/characterizing a manual welding exercise, the global coordinates of each desired operation path (i.e., vector) on any given workpiece will be determined. In most embodiments, this is a factory-executed calibration process that will include corresponding configuration files stored on data processing component 200. To obtain the desired vectors, a calibration device containing active or passive markers may be inserted on at least two locating markers in each of the three possible platform positions (i.e., flat, horizontal, and vertical). FIGS. 6-8 illustrate this calibration step in one possible platform position. Joint-specific fixture 46 includes first and second structural components 48 (horizontal) and 50 (vertical), respectively. Weld coupon or workpiece 54 includes first and second portions 56 (horizontal) and 58 (vertical), respectively. Workpiece operation path 59 extends from point X to point Y and is shown in broken line in FIG. 7 . Locating point markers 530 and 532 are placed as shown in FIG. 6 (and FIG. 8 ) and the location of each marker is obtained using data capturing component 100, which in this embodiment utilizes Optitrack Tracking Tools (NaturalPoint, Inc.) or a similar commercially available or proprietary hardware/software system that provides three-dimensional marker and six degrees of freedom object motion tracking in real time. Such technologies typically utilize reflective and/or light emitting point markers arranged in predetermined patterns to create point clouds that are interpreted by system imaging hardware and system software as “rigid bodies”, although other suitable methodologies are compatible with this invention.
[0030] In the calibration process represented by the flowchart of FIG. 9 , table 38 is fixed into position i (0,1,2) at step 280; a calibration device is placed on locating pins at step 282; all marker positions are captured at step 284; coordinates for the locator positions are calculated at step 286; coordinates for the fillet operation path are calculated at step 288 and stored at 290; coordinates for the lap operation path are calculated at step 292 and stored at 294; and coordinates for the groove operation path are calculated at step 296 and stored at 298. All coordinates are calculated relative to the three dimensional space viewable by data capturing component 200.
[0031] In one embodiment of this invention, the position and orientation of the work-piece is calibrated through the application of two or more passive or active point markers to a calibration device that is placed at a known translational and rotational offset to a fixture that holds the work-piece at a known translational and rotational offset. In another embodiment of this invention, the position and orientation of the work-piece is calibrated through the application of two or more passive or active point markers to a fixture that holds the work-piece at a known translational and rotational offset. In still other embodiments, the workpiece is non-linear, and the position and orientation thereof may be mapped using a calibration tool with two or more passive or active point markers and stored for later use. The position and orientation of the work-piece operation path may undergo a pre-determined translational and rotational offset from its original calibration plane based on the sequence steps in the overall work operation.
[0032] Important tool manipulation parameters such as position, orientation, velocity, acceleration, and spatial relationship to the work-piece operation path may be determined from the analysis of consecutive tool positions and orientations over time and the various work-piece operation paths described above. Tool manipulation parameters may be compared with pre-determined preferred values to determine deviations from known and preferred procedures. Tool manipulation parameters may also combined with other manufacturing process parameters to determine deviations from preferred procedures and these deviations may be used for assessing skill level, providing feedback for training, assessing progress toward a skill goal, or for quality control purposes. Recorded motion parameters relative to the workpiece operation path may be aggregated from multiple operations for statistical process control purposes. Deviations from preferred procedures may be aggregated from multiple operations for statistical process control purposes. Important tool manipulation parameters and tool positions and orientations with respect to the workpiece operation path may also be recorded for establishing a signature of an experienced operator's motions to be used as a baseline for assessing compliance with preferred procedures.
[0033] The second calibration aspect typically involves the calibration of welding tool 90 with respect to target 98. “Welding” tool 90 is typically a welding torch or gun or SMAW electrode holder, but may also be any number of other implements including a soldering iron, cutting torch, forming tool, material removal tool, paint gun, or wrench. With reference to FIGS. 10-11 , welding gun/tool 90 includes tool point 91, nozzle 92, body 94, trigger 96, and target 98. Tool calibration device 93, which includes two integrated active or passive point markers in the A and B positions (see FIG. 11 ) is attached to or inserted into nozzle 92. A rigid body point cloud (i.e., a “rigid body”) is constructed by attaching active or passive point markers 502, 504, and 506 (and additional point markers) to the upper surface of target 98 (other placements are possible). Target 98 may include a power input if the point markers used are active and require a power source. Data capturing component 200 uses Optitrack Tracking Tools (NaturalPoint, Inc.) or similar hardware/software to locate the rigid body and point markers 522 (A) and 520 (B), which represent the location of tool vector 524. These positions can be extracted from the software of system 10 and the relationship between point markers A and B and the rigid body can be calculated.
[0034] In the calibration process represented by the flowchart of FIG. 12 , weld nozzle 92 and the contact tube are removed at step 250; the calibration device is inserted into body 94 at step 252; weld tool 90 is placed in the working envelope and rigid body 500 (designated as “S” in FIG. 11 ) and point markers A and B are captured by data capturing component 100; the relationships between A and S and B and S are calculated at step 256; relationship data for As is stored at 258; and relationship data for Bs is stored at 260.
[0035] In one embodiment of this invention, calibration of the tool point and tool vector is performed through the application of two or more passive or active point markers to the calibration device at locations along the tool vector with a known offset to the tool point. In another embodiment, calibration of the tool point and tool vector is performed by inserting the tool into a calibration block of known position and orientation relative to the work-piece. With regard to the rigid body defined by the point markers (e.g., 502, 504, 506), in one embodiment, the passive or active point markers are affixed to the tool in a multi-faceted manner so that a wide range of rotation and orientation changes can be accommodated within the field of view of the imaging system. In another embodiment, the passive or active point markers are affixed to the tool in a spherical manner so that a wide range of rotation and orientation changes can be accommodated within the field of view of the imaging system. In still another embodiment, the passive or active point markers are affixed to the tool in a ring shape so that a wide range of rotation and orientation changes can be accommodated within the field of view of the imaging system.
[0036] Numerous additional useful features may be incorporated into the present invention. For example, for purposes of image filtering, band-pass or high-pass filters may be incorporated into the optical sequence for each of the plurality of digital cameras in data capturing component 200 for permitting light from only the wavelengths which are reflected or emitted from the point markers to improve image signal-to-noise ratio. Spurious data may be rejected by analyzing only image information obtained from within a dynamic region of interest having a limited offset from a previously known rigid-body locality. This dynamic region of interest may be incorporated into or otherwise predefined (i.e., preprogrammed as a box or region of width x and height y and centered on known positions of target 98) within the field of view of each digital camera such that image information is only processed from this predefined region. The region of interest will change as the rigid body moves and is therefore based on previously known locations of the rigid body. This approach allows the imaging system to view only pixels within the dynamic region of interest when searching for point markers while disregarding or blocking pixels in the larger image frame that are not included in the dynamic region of interest. Decreased processing time is a benefit of this aspect of the invention.
[0037] While the present invention has been illustrated by the description of exemplary embodiments thereof, and while the embodiments have been described in certain detail, it is not the intention of the Applicant to restrict or in any way limit the scope of the appended claims to such detail. Additional advantages and modifications will readily appear to those skilled in the art. Therefore, the invention in its broader aspects is not limited to any of the specific details, representative devices and methods, and/or illustrative examples shown and described. Accordingly, departures may be made from such details without departing from the spirit or scope of the applicant's general inventive concept.
Claims
The invention claimed is:
1. A system for characterizing a manual welding operation; said system comprising:
a stand structure comprising a horizontal welding platform; where said horizontal welding platform comprises a plurality of point markers having a predetermined relationship, and where said horizontal welding platform is configured to hold a workpiece to be welded in a manual welding operation;
a calibration device, said calibration device used to calibrate a position and orientation of an operational path for a weld joint on said workpiece;
a welding tool which is operative to perform said manual welding operation, and where said welding tool includes a plurality of point markers mounted thereon in a predetermined pattern;
an optical camera system comprising a plurality of optical cameras, where said optical camera system is coupled to said stand structure such that said plurality of optical cameras can image said plurality of point markers on said horizontal welding platform and said calibration device during said calibration, and said plurality of point markers on said welding tool during said manual welding operation; and
a data processing component coupled to said optical camera system to receive images from said plurality of optical cameras, where said data processing component determines each of:
the position and orientation of said operational path for said weld joint on said workpiece, where said position and orientation of said operational path is determined using images from said optical camera system regarding the positioning of said plurality of point markers on said horizontal welding platform and said calibration device, and
the 3-D position and orientation of said welding tool relative to said operational path during said manual welding operation, where said position and orientation of said welding tool is determined using images from said optical camera system regarding the position of said plurality of said point markers on said welding tool,
wherein said data processing component determines each of a work angle, a travel angle, a travel speed, a bead placement and a tool standoff distance, where said determinations are based on said determined position and orientation of said welding tool for said manual welding operation.
2. The system of claim 1, wherein said predetermined pattern of said plurality of point markers on said welding tool defines a rigid body and said data processing components uses said defined rigid body to determine at least one of said work angle, travel angle, travel speed, bead placement and tool standoff distance.
3. The system of claim 1, wherein said calibration device is in physical contact with said workpiece for said calibration of said position and orientation of said operational path.
4. The system of claim 1, wherein said plurality of point markers on said welding tool are light emitting point markers.
5. The system of claim 1, wherein said horizontal welding platform further comprises a plurality of clamps to secure said workpiece for said manual welding operation.
6. The system of claim 1, wherein said data processing component compares each of said determined work angle, travel angle, travel speed, bead placement and tool standoff distance to upper and lower thresholds for each of said work angle, travel angle, travel speed, bead placement and tool standoff distance, respectively.
7. The system of claim 6, wherein each of said upper and lower thresholds for each of said work angle, travel angle, travel speed, bead placement and tool standoff distance are pre-programmed into said data processing component.
8. The system of claim 1, wherein a performance score is determined by said data processing component for said manual welding operation, and where said performance score is determined using each of said determined work angle, travel angle, travel speed, bead placement and tool standoff distance.
9. The system of claim 1, wherein said data processing component processes said captured images using a frame-by-frame point cloud analysis.
10. The system of claim 1, wherein said calibration device includes at least one point marker which is imaged by said optical camera system.
11. A system for characterizing a manual welding operation; said system comprising:
a stand structure comprising a horizontal welding platform and a monitor; where said horizontal welding platform comprises a plurality of point markers having a predetermined relationship, and where said horizontal welding platform is configured to hold a workpiece to be welded in a manual welding operation;
a calibration device, said calibration device used to calibrate a position and orientation of an operational path for a weld joint on said workpiece, said calibration device having a point marker;
a welding tool which is operative to perform said manual welding operation, and where said welding tool includes a plurality of light emitting point markers mounted thereon in a predetermined pattern;
an optical camera system comprising a plurality of optical cameras, where said optical camera system is coupled to said stand structure such that said plurality of optical cameras can image said plurality of point markers on said horizontal welding platform and said point marker on said calibration device during said calibration, and said plurality of point markers on said welding tool during said manual welding operation; and
a data processing component coupled to said optical camera system to receive images from said plurality of optical cameras, where said data processing component determines each of:
the position and orientation of said operational path for said weld joint on said workpiece, where said position and orientation of said operational path is determined using images from said optical camera system regarding the positioning of said plurality of point markers on said horizontal welding platform and the positioning of said point marker on said calibration device, and
the 3-D position and orientation of said welding tool relative to said operational path during said manual welding operation, where said position and orientation of said welding tool is determined using images from said optical camera system regarding the position of said plurality of said light emitting point markers on said welding tool,
wherein said data processing component has a predefined rigid body for said plurality of light emitting point markers on said welding tool, and
wherein said data processing component determines each of a work angle, a travel angle, a travel speed, a bead placement and a tool standoff distance, where said determinations are based on said determined position and orientation of said welding tool for said manual welding operation and said predefined rigid body.
12. A method of characterizing a manual welding operation, said method comprising:
providing a plurality of welding parameters for a manual welding operation to a data processing component;
providing a workpiece to be welded by said manual welding operation;
mounting said workpiece on a weld platform of a stand structure, said weld platform including a plurality of point markers positioned in a predetermined pattern;
capturing a plurality of images of said point markers on said weld platform;
using a calibration device to identify a position and orientation of an operational path for said manual welding operation, said calibration device having at least one point marker;
capturing a plurality of images of said at least one point marker on said calibrating device;
processing said plurality of images of said point markers on said weld platform and said plurality of images of said at least one point marker on said calibration device to determine the position and orientation of said operational path of said manual welding operation;
providing a welding tool having a plurality of light emitting point markers, where said light emitting point markers are positioned in a predetermined pattern;
manually welding said workpiece with said welding tool;
capturing a plurality of images of said light emitting point markers on said welding tool during said manual welding operation;
processing said plurality of images of said light emitting point markers on said welding tool to determine a 3-D orientation and position of said welding tool during said manual welding operation; and
determining each of a welding tool work angle, welding tool travel angle, welding tool travel speed, bead placement and welding tool standoff distance for said manual welding operation, where each of said determinations is based on said determined 3-D orientation and position of said welding tool and said determined position and orientation of said operational path.
13. The method of claim 12, further comprising placing said calibration device in physical contact with said workpiece for said calibration.
14. The method of claim 12, further comprising comparing each of said determined work angle, travel angle, travel speed, bead placement and tool standoff distance to upper and lower thresholds for each of said work angle, travel angle, travel speed, bead placement and tool standoff distance, respectively.
15. The method of claim 12, further comprising determining a performance score for said manual welding operation, and where said performance score is determined using each of said determined work angle, travel angle, travel speed, bead placement and tool standoff distance.
16. The method of claim 12, further comprising comparing each of said determined work angle, travel angle, travel speed, bead placement and tool standoff distance to a preferred value for each of said work angle, travel angle, travel speed, bead placement and tool standoff distance, respectively.
17. The method of claim 12, wherein at least one of said processing steps uses a frame-by-frame point cloud analysis.
18. The method of claim 12, further comprising determining a quality of a weld created by said manual welding operation.
19. The method of claim 12, further comprising determining global coordinates for said operational path.
20. The method of claim 12, further comprising defining a rigid body based on said plurality of light emitting point markers on said welding tool and using said defined rigid body in said determination of each of said welding tool work angle, welding tool travel angle, welding tool travel speed, bead placement and welding tool standoff distance for said manual welding operation.
21. A system for characterizing a manual welding operation; said system comprising:
a stand structure comprising a horizontal welding platform; where said horizontal welding platform comprises a plurality of point markers having a predetermined relationship, and where said horizontal welding platform is configured to hold a workpiece to be welded in a manual welding operation;
a calibration device, said calibration device used to calibrate a position and orientation of a weld joint on said workpiece, said weld joint having an operational path;
a welding tool to perform said manual welding operation, and where said welding tool includes a plurality of point markers mounted thereon in a predetermined pattern;
a camera system comprising a plurality of cameras, where said camera system is coupled to said stand structure such that said plurality of cameras can image said plurality of point markers on said horizontal welding platform and said calibration device during said calibration, and said plurality of point markers on said welding tool during said manual welding operation; and
a data processing component coupled to said camera system to receive data from said camera system, where said data processing component determines each of:
the position and orientation of said operational path for said weld joint on said workpiece, where said position and orientation of said operational path is determined using data from said camera system regarding the positioning of said plurality of point markers on said horizontal welding platform and said calibration device, and
the 3-D position and orientation of said welding tool relative to said operational path during said manual welding operation, where said position and orientation of said welding tool is determined using data from said camera system regarding the position of said plurality of said point markers on said welding tool,
wherein said data processing component determines each of a work angle, a travel angle, and a travel speed, where said determinations are based on said determined position and orientation of said welding tool for said manual welding operation.
22. The system of claim 21, wherein said predetermined pattern of said plurality of point markers on said welding tool defines a rigid body and said data processing components uses said defined rigid body to determine at least one of said work angle, travel angle, and travel speed.
23. The system of claim 21, wherein said calibration device is in physical contact with said workpiece for said calibration of said position and orientation of said operational path.
24. The system of claim 21, wherein said plurality of point markers on said welding tool are light emitting point markers.
25. The system of claim 21, wherein said horizontal welding platform further comprises a plurality of clamps to secure said workpiece for said manual welding operation.
26. The system of claim 21, wherein said data processing component compares each of said determined work angle, travel angle, and travel speed to upper and lower thresholds for each of said work angle, travel angle, and travel speed, respectively.
27. The system of claim 26, wherein each of said upper and lower thresholds for each of said work angle, travel angle, and travel speed are pre-programmed into said data processing component.
28. The system of claim 21, wherein a performance score is determined by said data processing component for said manual welding operation, and where said performance score is determined using each of said determined work angle, travel angle, and travel speed.
29. The system of claim 21, wherein said data corresponds to a plurality of images captured by said camera system, and where said data processing component processes the captured images using a frame-by-frame point cloud analysis.
30. The system of claim 21, wherein said calibration device includes at least one point marker which is imaged by said camera system.
Patent Citations (531)
| Patent | Date | Inventor | Cited By |
|---|---|---|---|
| US317063(A) | 1885-05-01 | Wittenstrom | Applicant |
| US428459(A) | 1890-05-01 | Coffin | Applicant |
| US483428(A) | 1892-09-01 | Goppin | Applicant |
| US1159119(A) | 1915-11-01 | Springer | Applicant |
| US1286529(A) | 1918-12-01 | Cave | Applicant |
| US2326944(A) | 1943-08-01 | Holand et al. | Applicant |
| US2333192(A) | 1943-11-01 | Mobert | Applicant |
| USD140630(S) | 1945-03-01 | Garibay | Applicant |
| USD142377(S) | 1945-09-01 | Dunn | Applicant |
| USD152049(S) | 1948-12-01 | Welch | Applicant |
| US2681969(A) | 1954-06-01 | Burke | Applicant |
| USD174208(S) | 1955-03-01 | Abidgaard | Applicant |
| US2728838(A) | 1955-12-01 | Barnes | Applicant |
| USD176942(S) | 1956-02-01 | Cross | Applicant |
| US2894086(A) | 1959-07-01 | Rizer | Applicant |
| US3035155(A) | 1962-05-01 | Hawk | Applicant |
| US3059519(A) | 1962-10-01 | Stanton | Applicant |
| US3356823(A) | 1967-12-01 | Waters et al. | Applicant |
| US3555239(A) | 1971-01-01 | Kerth | Applicant |
| US3562927(A) | 1971-02-01 | Moskowitz | Applicant |
| US3562928(A) | 1971-02-01 | Schmitt | Applicant |
| US3621177(A) | 1971-11-01 | McPherson et al. | Applicant |
| US3654421(A) | 1972-04-01 | Streetman et al. | Applicant |
| US3690020(A) | 1972-09-01 | McBratnie | Applicant |
| US3739140(A) | 1973-06-01 | Rotilio | Applicant |
| US3866011(A) | 1975-02-01 | Cole | Applicant |
| US3867769(A) | 1975-02-01 | Schow et al. | Applicant |
| US3904845(A) | 1975-09-01 | Minkiewicz | Applicant |
| US3988913(A) | 1976-11-01 | Metcalfe et al. | Applicant |
| USD243459(S) | 1977-02-01 | Bliss | Applicant |
| US4024371(A) | 1977-05-01 | Drake | Applicant |
| US4041615(A) | 1977-08-01 | Whitehill | Applicant |
| USD247421(S) | 1978-03-01 | Driscoll | Applicant |
| US4124944(A) | 1978-11-01 | Blair | Applicant |
| US4132014(A) | 1979-01-01 | Schow | Applicant |
| US4237365(A) | 1980-12-01 | Lambros et al. | Applicant |
| US4280041(A) | 1981-07-01 | Kiessling et al. | Applicant |
| US4280137(A) | 1981-07-01 | Ashida et al. | Applicant |
| US4314125(A) | 1982-02-01 | Nakamura | Applicant |
| US4354087(A) | 1982-10-01 | Osterlitz | Applicant |
| US4359622(A) | 1982-11-01 | Dostoomian et al. | Applicant |
| US4375026(A) | 1983-02-01 | Kearney | Applicant |
| US4410787(A) | 1983-10-01 | Kremers et al. | Applicant |
| US4429266(A) | 1984-01-01 | Tradt | Applicant |
| US4452589(A) | 1984-06-01 | Denison | Applicant |
| USD275292(S) | 1984-08-01 | Bouman | Applicant |
| USD277761(S) | 1985-02-01 | Korovin et al. | Applicant |
| US4525619(A) | 1985-06-01 | Ide et al. | Applicant |
| USD280329(S) | 1985-08-01 | Bouman | Applicant |
| US4611111(A) | 1986-09-01 | Baheti et al. | Applicant |
| US4616326(A) | 1986-10-01 | Meier et al. | Applicant |
| US4629860(A) | 1986-12-01 | Lindbom | Applicant |
| US4677277(A) | 1987-06-01 | Cook et al. | Applicant |
| US4680014(A) | 1987-07-01 | Paton et al. | Applicant |
| US4689021(A) | 1987-08-01 | Vasiliev et al. | Applicant |
| US4707582(A) | 1987-11-01 | Beyer | Applicant |
| US4716273(A) | 1987-12-01 | Paton et al. | Applicant |
| USD297704(S) | 1988-09-01 | Bulow | Applicant |
| US4812614(A) | 1989-03-01 | Wang et al. | Applicant |
| US4867685(A) | 1989-09-01 | Brush et al. | Applicant |
| US4877940(A) | 1989-10-01 | Bangs et al. | Applicant |
| US4897521(A) | 1990-01-01 | Burr | Applicant |
| US4907973(A) | 1990-03-01 | Hon | Applicant |
| US4931018(A) | 1990-06-01 | Herbst et al. | Applicant |
| US4973814(A) | 1990-11-01 | Kojima | Applicant |
| US4998050(A) | 1991-03-01 | Nishiyama et al. | Applicant |
| US5034593(A) | 1991-07-01 | Rice et al. | Applicant |
| US5061841(A) | 1991-10-01 | Richardson | Applicant |
| US5089914(A) | 1992-02-01 | Prescott | Applicant |
| US5192845(A) | 1993-03-01 | Kirmsse et al. | Applicant |
| US5206472(A) | 1993-04-01 | Myking et al. | Applicant |
| US5266930(A) | 1993-11-01 | Ichikawa et al. | Applicant |
| US5283418(A) | 1994-02-01 | Bellows et al. | Applicant |
| US5285916(A) | 1994-02-01 | Ross | Applicant |
| US5288968(A) | 1994-02-01 | Cecil | Applicant |
| US5305183(A) | 1994-04-01 | Teynor | Applicant |
| US5320538(A) | 1994-06-01 | Baum | Applicant |
| US5337611(A) | 1994-08-01 | Fleming et al. | Applicant |
| US5360156(A) | 1994-11-01 | Ishizaka et al. | Applicant |
| US5360960(A) | 1994-11-01 | Shirk | Applicant |
| US5362962(A) | 1994-11-01 | Barborak et al. | Applicant |
| US5370071(A) | 1994-12-01 | Ackermann | Applicant |
| USD359296(S) | 1995-06-01 | Witherspoon | Applicant |
| US5424634(A) | 1995-06-01 | Goldfarb et al. | Applicant |
| US5436638(A) | 1995-07-01 | Bolas et al. | Applicant |
| US5464957(A) | 1995-11-01 | Kidwell et al. | Applicant |
| US5465037(A) | 1995-11-01 | Huissoon et al. | Applicant |
| USD365583(S) | 1995-12-01 | Viken | Applicant |
| US5493093(A) | 1996-02-01 | Cecil | Applicant |
| US5547052(A) | 1996-08-01 | Latshaw | Applicant |
| US5562843(A) | 1996-10-01 | Yasumoto | Applicant |
| US5670071(A) | 1997-09-01 | Ueyama et al. | Applicant |
| US5676503(A) | 1997-10-01 | Lang | Applicant |
| US5676867(A) | 1997-10-01 | Allen | Applicant |
| US5708253(A) | 1998-01-01 | Bloch et al. | Applicant |
| US5710405(A) | 1998-01-01 | Solomon et al. | Applicant |
| US5719369(A) | 1998-02-01 | White et al. | Applicant |
| USD392534(S) | 1998-03-01 | Degen et al. | Applicant |
| US5728991(A) | 1998-03-01 | Takada et al. | Applicant |
| US5751258(A) | 1998-05-01 | Fergason et al. | Applicant |
| USD395296(S) | 1998-06-01 | Kaya et al. | Applicant |
| US5774110(A) | 1998-06-01 | Edelson | Applicant |
| USD396238(S) | 1998-07-01 | Schmitt | Applicant |
| US5781258(A) | 1998-07-01 | Dabral et al. | Applicant |
| US5823785(A) | 1998-10-01 | Matherne | Applicant |
| US5835077(A) | 1998-11-01 | Dao et al. | Applicant |
| US5835277(A) | 1998-11-01 | Hegg | Applicant |
| US5845053(A) | 1998-12-01 | Watanabe et al. | Applicant |
| US5877777(A) | 1999-03-01 | Colwell | Applicant |
| US5963891(A) | 1999-10-01 | Walker et al. | Applicant |
| US6008470(A) | 1999-12-01 | Zhang et al. | Applicant |
| US6037948(A) | 2000-03-01 | Liepa | Applicant |
| US6049059(A) | 2000-04-01 | Kim | Applicant |
| US6051805(A) | 2000-04-01 | Vaidya et al. | Applicant |
| US6114645(A) | 2000-09-01 | Burgess | Applicant |
| US6155475(A) | 2000-12-01 | Ekelof et al. | Applicant |
| US6155928(A) | 2000-12-01 | Burdick | Applicant |
| US6230327(B1) | 2001-05-01 | Briand et al. | Applicant |
| US6236013(B1) | 2001-05-01 | Delzenne | Applicant |
| US6236017(B1) | 2001-05-01 | Smartt et al. | Applicant |
| US6242711(B1) | 2001-06-01 | Cooper | Applicant |
| US6271500(B1) | 2001-08-01 | Hirayama et al. | Applicant |
| US6301763(B1) | 2001-10-01 | Pryor | Applicant |
| US6330938(B1) | 2001-12-01 | Herve et al. | Applicant |
| US6330966(B1) | 2001-12-01 | Eissfeller | Applicant |
| US6331848(B1) | 2001-12-01 | Stove et al. | Applicant |
| USD456428(S) | 2002-04-01 | Aronson et al. | Applicant |
| US6373465(B2) | 2002-04-01 | Jolly et al. | Applicant |
| US6377011(B1) | 2002-04-01 | Ben-Ur | Applicant |
| USD456828(S) | 2002-05-01 | Aronson et al. | Applicant |
| US6396232(B2) | 2002-05-01 | Haanpaa et al. | Applicant |
| USD461383(S) | 2002-08-01 | Blackburn | Applicant |
| US6427352(B1) | 2002-08-01 | Pfeiffer et al. | Applicant |
| US6441342(B1) | 2002-08-01 | Hsu | Applicant |
| US6445964(B1) | 2002-09-01 | White et al. | Applicant |
| US6492618(B1) | 2002-12-01 | Flood et al. | Applicant |
| US6506997(B2) | 2003-01-01 | Matsuyama | Applicant |
| US6552303(B1) | 2003-04-01 | Blankenship et al. | Applicant |
| US6560029(B1) | 2003-05-01 | Dobbie et al. | Applicant |
| US6563489(B1) | 2003-05-01 | Latypov et al. | Applicant |
| US6568846(B1) | 2003-05-01 | Cote et al. | Applicant |
| USD475726(S) | 2003-06-01 | Suga et al. | Applicant |
| US6572379(B1) | 2003-06-01 | Sears et al. | Applicant |
| US6583386(B1) | 2003-06-01 | Ivkovich | Applicant |
| US6593540(B1) | 2003-07-01 | Baker et al. | Applicant |
| US6621049(B2) | 2003-09-01 | Suzuki | Applicant |
| US6624388(B1) | 2003-09-01 | Blankenship et al. | Applicant |
| USD482171(S) | 2003-11-01 | Vui et al. | Applicant |
| US6647288(B2) | 2003-11-01 | Madill et al. | Applicant |
| US6649858(B2) | 2003-11-01 | Wakeman | Applicant |
| US6655645(B1) | 2003-12-01 | Lu et al. | Applicant |
| US6660965(B2) | 2003-12-01 | Simpson | Applicant |
| US6679702(B1) | 2004-01-01 | Rau | Applicant |
| US6697701(B2) | 2004-02-01 | Hillen et al. | Applicant |
| US6697770(B1) | 2004-02-01 | Nagetgaal | Applicant |
| US6703585(B2) | 2004-03-01 | Suzuki | Applicant |
| US6708385(B1) | 2004-03-01 | Lemelson | Applicant |
| US6710298(B2) | 2004-03-01 | Eriksson | Applicant |
| US6710299(B2) | 2004-03-01 | Blankenship et al. | Applicant |
| US6715502(B1) | 2004-04-01 | Rome et al. | Applicant |
| USD490347(S) | 2004-05-01 | Meyers | Applicant |
| US6730875(B2) | 2004-05-01 | Hsu | Applicant |
| US6734393(B1) | 2004-05-01 | Friedl et al. | Applicant |
| US6744011(B1) | 2004-06-01 | Hu et al. | Applicant |
| US6750428(B2) | 2004-06-01 | Okamoto et al. | Applicant |
| US6765584(B1) | 2004-07-01 | Wloka et al. | Applicant |
| US6772802(B2) | 2004-08-01 | Few | Applicant |
| US6788442(B1) | 2004-09-01 | Potin et al. | Applicant |
| US6795778(B2) | 2004-09-01 | Dodge et al. | Applicant |
| US6798974(B1) | 2004-09-01 | Nakano et al. | Applicant |
| US6857553(B1) | 2005-02-01 | Hartman et al. | Applicant |
| US6858817(B2) | 2005-02-01 | Blankenship et al. | Applicant |
| US6865926(B2) | 2005-03-01 | O'Brien et al. | Applicant |
| USD504449(S) | 2005-04-01 | Butchko | Applicant |
| US6920371(B2) | 2005-07-01 | Hillen et al. | Applicant |
| US6940039(B2) | 2005-09-01 | Blankenship et al. | Applicant |
| US6982700(B2) | 2006-01-01 | Rosenberg et al. | Applicant |
| US7021937(B2) | 2006-04-01 | Simpson et al. | Applicant |
| US7024342(B1) | 2006-04-01 | Waite | Applicant |
| US7110859(B2) | 2006-09-01 | Shibata et al. | Applicant |
| US7126078(B2) | 2006-10-01 | Demers et al. | Applicant |
| US7132617(B2) | 2006-11-01 | Lee et al. | Applicant |
| US7170032(B2) | 2007-01-01 | Flood | Applicant |
| US7194447(B2) | 2007-03-01 | Harvey | Applicant |
| US7233837(B2) | 2007-06-01 | Swain et al. | Applicant |
| US7247814(B2) | 2007-07-01 | Ott | Applicant |
| USD555446(S) | 2007-11-01 | Picaza Ibarrondo | Applicant |
| US7298535(B2) | 2007-11-01 | Kuutti | Applicant |
| US7315241(B1) | 2008-01-01 | Daily et al. | Applicant |
| USD561973(S) | 2008-02-01 | Kinsley et al. | Applicant |
| US7353715(B2) | 2008-04-01 | Myers | Applicant |
| US7363137(B2) | 2008-04-01 | Brant et al. | Applicant |
| US7375304(B2) | 2008-05-01 | Kainec et al. | Applicant |
| US7381923(B2) | 2008-06-01 | Gordon et al. | Applicant |
| US7414595(B1) | 2008-08-01 | Muffler | Applicant |
| US7465230(B2) | 2008-12-01 | LeMay et al. | Applicant |
| US7474760(B2) | 2009-01-01 | Hertzman et al. | Applicant |
| US7478108(B2) | 2009-01-01 | Townsend et al. | Applicant |
| US7487018(B2) | 2009-02-01 | Afshar et al. | Applicant |
| USD587975(S) | 2009-03-01 | Aronson et al. | Applicant |
| US7516022(B2) | 2009-04-01 | Lee et al. | Applicant |
| US7580821(B2) | 2009-08-01 | Schirm | Applicant |
| USD602057(S) | 2009-10-01 | Osicki | Applicant |
| US7621171(B2) | 2009-11-01 | O'Brien | Applicant |
| USD606102(S) | 2009-12-01 | Bender et al. | Applicant |
| US7643890(B1) | 2010-01-01 | Hillen et al. | Applicant |
| US7687741(B2) | 2010-03-01 | Kainec et al. | Applicant |
| USD614217(S) | 2010-04-01 | Peters et al. | Applicant |
| USD615573(S) | 2010-05-01 | Peters et al. | Applicant |
| US7817162(B2) | 2010-10-01 | Bolick et al. | Applicant |
| US7853645(B2) | 2010-12-01 | Brown et al. | Applicant |
| USD631074(S) | 2011-01-01 | Peters et al. | Applicant |
| US7874921(B2) | 2011-01-01 | Baszucki et al. | Applicant |
| US7970172(B1) | 2011-06-01 | Hendrickson | Applicant |
| US7972129(B2) | 2011-07-01 | O'Donoghue | Applicant |
| US7991587(B2) | 2011-08-01 | Ihn | Applicant |
| US8069017(B2) | 2011-11-01 | Hallquist | Applicant |
| US8224881(B1) | 2012-07-01 | Spear et al. | Applicant |
| US8248324(B2) | 2012-08-01 | Nangle | Applicant |
| US8265886(B2) | 2012-09-01 | Bisiaux et al. | Applicant |
| US8274013(B2) | 2012-09-01 | Wallace | Applicant |
| US8287522(B2) | 2012-10-01 | Moses et al. | Applicant |
| US8301286(B2) | 2012-10-01 | Babu | Applicant |
| US8316462(B2) | 2012-11-01 | Becker et al. | Applicant |
| US8363048(B2) | 2013-01-01 | Gering | Applicant |
| US8365603(B2) | 2013-02-01 | Lesage et al. | Applicant |
| US8512043(B2) | 2013-08-01 | Choquet | Applicant |
| US8569646(B2) | 2013-10-01 | Daniel et al. | Applicant |
| US8592723(B2) | 2013-11-01 | Davidson et al. | Applicant |
| US8657605(B2) | 2014-02-01 | Wallace et al. | Applicant |
| US8692157(B2) | 2014-04-01 | Daniel et al. | Applicant |
| US8747116(B2) | 2014-06-01 | Zboray et al. | Applicant |
| US8777629(B2) | 2014-07-01 | Kreindl et al. | Applicant |
| US8787051(B2) | 2014-07-01 | Chang et al. | Applicant |
| US8834168(B2) | 2014-09-01 | Peters et al. | Applicant |
| US8851896(B2) | 2014-10-01 | Wallace et al. | Applicant |
| US8911237(B2) | 2014-12-01 | Postlethwaite et al. | Applicant |
| US8915740(B2) | 2014-12-01 | Zboray et al. | Applicant |
| USRE45398(E) | 2015-03-01 | Wallace | Applicant |
| US8992226(B1) | 2015-03-01 | Leach et al. | Applicant |
| US9011154(B2) | 2015-04-01 | Kindig et al. | Applicant |
| US9293056(B2) | 2016-03-01 | Zboray | Applicant |
| US9293057(B2) | 2016-03-01 | Zboray | Applicant |
| US2001/0045808(A1) | 2001-11-01 | Heitmann et al. | Applicant |
| US2001/0052893(A1) | 2001-12-01 | Jolly et al. | Applicant |
| US2002/0032553(A1) | 2002-03-01 | Simpson et al. | Applicant |
| US2002/0039138(A1) | 2002-04-01 | Edelson et al. | Applicant |
| US2002/0046999(A1) | 2002-04-01 | Veikkolainen et al. | Applicant |
| US2002/0050984(A1) | 2002-05-01 | Roberts | Applicant |
| US2002/0054211(A1) | 2002-05-01 | Edelson et al. | Applicant |
| US2002/0085843(A1) | 2002-07-01 | Mann | Applicant |
| US2002/0094026(A1) | 2002-07-01 | Edelson | Applicant |
| US2002/0111557(A1) | 2002-08-01 | Madill et al. | Applicant |
| US2002/0135695(A1) | 2002-09-01 | Edelson et al. | Applicant |
| US2002/0175897(A1) | 2002-11-01 | Pelosi | Applicant |
| US2002/0180761(A1) | 2002-12-01 | Edelson et al. | Applicant |
| US2003/0000931(A1) | 2003-01-01 | Ueda et al. | Applicant |
| US2003/0002740(A1) | 2003-01-01 | Melikian | Applicant |
| US2003/0023592(A1) | 2003-01-01 | Modica et al. | Applicant |
| US2003/0025884(A1) | 2003-02-01 | Hamana et al. | Applicant |
| US2003/0075534(A1) | 2003-04-01 | Okamoto | Applicant |
| US2003/0106787(A1) | 2003-06-01 | Santilli | Applicant |
| US2003/0111451(A1) | 2003-06-01 | Blankenship et al. | Applicant |
| US2003/0172032(A1) | 2003-09-01 | Choquet | Applicant |
| US2003/0186199(A1) | 2003-10-01 | McCool et al. | Applicant |
| US2003/0228560(A1) | 2003-12-01 | Seat et al. | Applicant |
| US2003/0234885(A1) | 2003-12-01 | Pilu | Applicant |
| US2004/0020907(A1) | 2004-02-01 | Zauner et al. | Applicant |
| US2004/0035990(A1) | 2004-02-01 | Ackeret | Applicant |
| US2004/0050824(A1) | 2004-03-01 | Samler | Applicant |
| US2004/0088071(A1) | 2004-05-01 | Kouno | Applicant |
| US2004/0140301(A1) | 2004-07-01 | Blankenship et al. | Applicant |
| US2004/0181382(A1) | 2004-09-01 | Hu | Applicant |
| US2005/0007504(A1) | 2005-01-01 | Fergason | Applicant |
| US2005/0017152(A1) | 2005-01-01 | Fergason | Applicant |
| US2005/0046584(A1) | 2005-03-01 | Breed | Applicant |
| US2005/0050168(A1) | 2005-03-01 | Wen et al. | Applicant |
| US2005/0101767(A1) | 2005-05-01 | Clapham et al. | Applicant |
| US2005/0103766(A1) | 2005-05-01 | Iizuka et al. | Applicant |
| US2005/0103767(A1) | 2005-05-01 | Kainec et al. | Applicant |
| US2005/0109735(A1) | 2005-05-01 | Flood | Applicant |
| US2005/0128186(A1) | 2005-06-01 | Shahoian et al. | Applicant |
| US2005/0133488(A1) | 2005-06-01 | Blankenship et al. | Applicant |
| US2005/0159840(A1) | 2005-07-01 | Lin et al. | Applicant |
| US2005/0163364(A1) | 2005-07-01 | Beck | Applicant |
| US2005/0189336(A1) | 2005-09-01 | Ku | Applicant |
| US2005/0199602(A1) | 2005-09-01 | Kaddani et al. | Applicant |
| US2005/0230573(A1) | 2005-10-01 | Ligertwood | Applicant |
| US2005/0252897(A1) | 2005-11-01 | Hsu et al. | Applicant |
| US2005/0275913(A1) | 2005-12-01 | Vesely et al. | Applicant |
| US2005/0275914(A1) | 2005-12-01 | Vesely et al. | Applicant |
| US2006/0014130(A1) | 2006-01-01 | Weinstein | Applicant |
| US2006/0076321(A1) | 2006-04-01 | Maev | Applicant |
| US2006/0136183(A1) | 2006-06-01 | Choquet | Applicant |
| US2006/0140502(A1) | 2006-06-01 | Tseng et al. | Applicant |
| US2006/0154226(A1) | 2006-07-01 | Maxfield | Applicant |
| US2006/0163227(A1) | 2006-07-01 | Hillen et al. | Applicant |
| US2006/0166174(A1) | 2006-07-01 | Rowe | Applicant |
| US2006/0169682(A1) | 2006-08-01 | Kainec et al. | Applicant |
| US2006/0173619(A1) | 2006-08-01 | Brant et al. | Applicant |
| US2006/0189260(A1) | 2006-08-01 | Sung | Applicant |
| US2006/0207980(A1) | 2006-09-01 | Jacovetty et al. | Applicant |
| US2006/0213892(A1) | 2006-09-01 | Ott | Applicant |
| US2006/0214924(A1) | 2006-09-01 | Kawamoto et al. | Applicant |
| US2006/0226137(A1) | 2006-10-01 | Huismann et al. | Applicant |
| US2006/0241432(A1) | 2006-10-01 | Herline et al. | Applicant |
| US2006/0252543(A1) | 2006-11-01 | Van Noland et al. | Applicant |
| US2006/0258447(A1) | 2006-11-01 | Baszucki et al. | Applicant |
| US2007/0034611(A1) | 2007-02-01 | Drius et al. | Applicant |
| US2007/0038400(A1) | 2007-02-01 | Lee et al. | Applicant |
| US2007/0045488(A1) | 2007-03-01 | Shin | Applicant |
| US2007/0088536(A1) | 2007-04-01 | Ishikawa | Applicant |
| US2007/0112889(A1) | 2007-05-01 | Cook et al. | Applicant |
| US2007/0188606(A1) | 2007-08-01 | Atkinson et al. | Applicant |
| US2007/0198117(A1) | 2007-08-01 | Wajhuddin | Applicant |
| US2007/0211026(A1) | 2007-09-01 | Ohta et al. | Applicant |
| US2007/0221797(A1) | 2007-09-01 | Thompson et al. | Applicant |
| US2007/0256503(A1) | 2007-11-01 | Wong et al. | Applicant |
| US2007/0264620(A1) | 2007-11-01 | Maddix et al. | Applicant |
| US2007/0277611(A1) | 2007-12-01 | Portzgen et al. | Applicant |
| US2007/0291035(A1) | 2007-12-01 | Vesely et al. | Applicant |
| US2008/0021311(A1) | 2008-01-01 | Goldbach | Applicant |
| US2008/0027594(A1) | 2008-01-01 | Jump et al. | Applicant |
| US2008/0031774(A1) | 2008-02-01 | Magnant et al. | Applicant |
| US2008/0038702(A1) | 2008-02-01 | Choquet | Applicant |
| US2008/0078811(A1) | 2008-04-01 | Hillen et al. | Applicant |
| US2008/0078812(A1) | 2008-04-01 | Peters et al. | Applicant |
| US2008/0107345(A1) | 2008-05-01 | Melikian | Applicant |
| US2008/0117203(A1) | 2008-05-01 | Gering | Applicant |
| US2008/0120075(A1) | 2008-05-01 | Wloka | Applicant |
| US2008/0128398(A1) | 2008-06-01 | Schneider | Applicant |
| US2008/0135533(A1) | 2008-06-01 | Ertmer et al. | Applicant |
| US2008/0140815(A1) | 2008-06-01 | Brant et al. | Applicant |
| US2008/0149686(A1) | 2008-06-01 | Daniel et al. | Applicant |
| US2008/0203075(A1) | 2008-08-01 | Feldhausen et al. | Applicant |
| US2008/0233550(A1) | 2008-09-01 | Solomon | Applicant |
| US2008/0249998(A1) | 2008-10-01 | Dettinger et al. | Applicant |
| US2008/0303197(A1) | 2008-12-01 | Paquette et al. | Applicant |
| US2008/0314887(A1) | 2008-12-01 | Stoger et al. | Applicant |
| US2009/0015585(A1) | 2009-01-01 | Klusza | Applicant |
| US2009/0021514(A1) | 2009-01-01 | Klusza | Applicant |
| US2009/0045183(A1) | 2009-02-01 | Artelsmair et al. | Applicant |
| US2009/0057286(A1) | 2009-03-01 | Ihara et al. | Applicant |
| US2009/0109128(A1) | 2009-04-01 | Nangle | Applicant |
| US2009/0152251(A1) | 2009-06-01 | Dantinne et al. | Applicant |
| US2009/0173726(A1) | 2009-07-01 | Davidson et al. | Applicant |
| US2009/0184098(A1) | 2009-07-01 | Daniel et al. | Applicant |
| US2009/0197228(A1) | 2009-08-01 | Afshar et al. | Applicant |
| US2009/0200281(A1) | 2009-08-01 | Hampton | Applicant |
| US2009/0200282(A1) | 2009-08-01 | Hampton | Applicant |
| US2009/0231423(A1) | 2009-09-01 | Becker et al. | Applicant |
| US2009/0257655(A1) | 2009-10-01 | Melikian | Applicant |
| US2009/0259444(A1) | 2009-10-01 | Dolansky et al. | Applicant |
| US2009/0298024(A1) | 2009-12-01 | Batzier et al. | Applicant |
| US2009/0312958(A1) | 2009-12-01 | Dai et al. | Applicant |
| US2009/0325699(A1) | 2009-12-01 | Delgiannidis | Applicant |
| US2010/0012017(A1) | 2010-01-01 | Miller | Applicant |
| US2010/0012637(A1) | 2010-01-01 | Jaeger | Applicant |
| US2010/0021051(A1) | 2010-01-01 | Melikian | Applicant |
| US2010/0048273(A1) | 2010-02-01 | Wallace et al. | Applicant |
| US2010/0062405(A1) | 2010-03-01 | Zboray et al. | Applicant |
| US2010/0062406(A1) | 2010-03-01 | Zboray et al. | Applicant |
| US2010/0096373(A1) | 2010-04-01 | Hillen et al. | Applicant |
| US2010/0121472(A1) | 2010-05-01 | Babu et al. | Applicant |
| US2010/0133247(A1) | 2010-06-01 | Mazumder et al. | Applicant |
| US2010/0133250(A1) | 2010-06-01 | Sardy et al. | Applicant |
| US2010/0176107(A1) | 2010-07-01 | Bong | Applicant |
| US2010/0201803(A1) | 2010-08-01 | Melikian | Applicant |
| US2010/0224610(A1) | 2010-09-01 | Wallace | Applicant |
| US2010/0276396(A1) | 2010-11-01 | Cooper | Applicant |
| US2010/0299101(A1) | 2010-11-01 | Shimada et al. | Applicant |
| US2010/0307249(A1) | 2010-12-01 | Lesage et al. | Applicant |
| US2011/0006047(A1) | 2011-01-01 | Penrod | Applicant |
| US2011/0048273(A1) | 2011-03-01 | Colon | Applicant |
| US2011/0052046(A1) | 2011-03-01 | Melikian | Applicant |
| US2011/0060568(A1) | 2011-03-01 | Goldfine | Applicant |
| US2011/0082728(A1) | 2011-04-01 | Melikian | Applicant |
| US2011/0091846(A1) | 2011-04-01 | Kreindl et al. | Applicant |
| US2011/0114615(A1) | 2011-05-01 | Daniel et al. | Applicant |
| US2011/0116076(A1) | 2011-05-01 | Chantry et al. | Applicant |
| US2011/0117527(A1) | 2011-05-01 | Conrardy | Applicant |
| US2011/0122495(A1) | 2011-05-01 | Togashi | Applicant |
| US2011/0183304(A1) | 2011-07-01 | Wallace et al. | Applicant |
| US2011/0187746(A1) | 2011-08-01 | Suto et al. | Applicant |
| US2011/0187859(A1) | 2011-08-01 | Edelson | Applicant |
| US2011/0229864(A1) | 2011-09-01 | Short et al. | Applicant |
| US2011/0248864(A1) | 2011-10-01 | Becker et al. | Applicant |
| US2011/0316516(A1) | 2011-12-01 | Schiefermuller et al. | Applicant |
| US2012/0189993(A1) | 2012-07-01 | Kinding et al. | Applicant |
| US2012/0291172(A1) | 2012-11-01 | Wills et al. | Applicant |
| US2012/0298640(A1) | 2012-11-01 | Conrardy et al. | Applicant |
| US2013/0026150(A1) | 2013-01-01 | Chantry et al. | Applicant |
| US2013/0040270(A1) | 2013-02-01 | Albrecht | Applicant |
| US2013/0049976(A1) | 2013-02-01 | Maggiore | Applicant |
| US2013/0075380(A1) | 2013-03-01 | Albrech et al. | Applicant |
| US2013/0119040(A1) | 2013-05-01 | Suraba et al. | Applicant |
| US2013/0170259(A1) | 2013-07-01 | Chang et al. | Applicant |
| US2013/0182070(A1) | 2013-07-01 | Peters et al. | Applicant |
| US2013/0183645(A1) | 2013-07-01 | Wallace et al. | Applicant |
| US2013/0189657(A1) | 2013-07-01 | Wallace et al. | Applicant |
| US2013/0189658(A1) | 2013-07-01 | Peters et al. | Applicant |
| US2013/0203029(A1) | 2013-08-01 | Choquet | Applicant |
| US2013/0206740(A1) | 2013-08-01 | Pfeifer et al. | Applicant |
| US2013/0209976(A1) | 2013-08-01 | Postlethwaite et al. | Applicant |
| US2013/0230832(A1) | 2013-09-01 | Peters et al. | Applicant |
| US2013/0231980(A1) | 2013-09-01 | Elgart et al. | Applicant |
| US2013/0252214(A1) | 2013-09-01 | Choquet | Applicant |
| US2013/0288211(A1) | 2013-10-01 | Patterson et al. | Applicant |
| US2013/0327747(A1) | 2013-12-01 | Dantinne | Applicant |
| US2013/0342678(A1) | 2013-12-01 | McAninch et al. | Applicant |
| US2014/0038143(A1) | 2014-02-01 | Daniel | Applicant |
| US2014/0042136(A1) | 2014-02-01 | Daniel et al. | Applicant |
| US2014/0134580(A1) | 2014-05-01 | Becker | Applicant |
| US2014/0263224(A1) | 2014-09-01 | Becker | Applicant |
| US2014/0272835(A1) | 2014-09-01 | Becker | Applicant |
| US2014/0272836(A1) | 2014-09-01 | Becker | Applicant |
| US2014/0272837(A1) | 2014-09-01 | Becker | Applicant |
| US2014/0272838(A1) | 2014-09-01 | Becker | Applicant |
| US2014/0346158(A1) | 2014-11-01 | Matthews | Applicant |
| US2015/0056584(A1) | 2015-02-01 | Boulware et al. | Applicant |
| US2015/0056585(A1) | 2015-02-01 | Boulware et al. | Applicant |
| US2015/0056586(A1) | 2015-02-01 | Penrod | Applicant |
| US2015/0072323(A1) | 2015-03-01 | Postlethwaite | Applicant |
| US2015/0125836(A1) | 2015-05-01 | Daniel | Applicant |
| US2015/0194073(A1) | 2015-07-01 | Becker et al. | Applicant |
| US2015/0235565(A1) | 2015-08-01 | Postlethwaite | Applicant |
| US2015/0248845(A1) | 2015-09-01 | Postlethwaite | Applicant |
| US2016/0093233(A1) | 2016-03-01 | Boulware | Applicant |
| US2016/0203735(A1) | 2016-07-01 | Boulware | Applicant |
| US2016/0343268(A1) | 2016-11-01 | Postlethwaite | Applicant |
| CA2698078 | 2011-09-01 | Applicant | |
| CN1665633 | 2005-09-01 | Applicant | |
| CN201083660 | 2008-07-01 | Applicant | |
| CN201149744 | 2008-11-01 | Applicant | |
| CN101406978 | 2009-04-01 | Applicant | |
| CN101419755 | 2009-04-01 | Applicant | |
| CN201229711 | 2009-04-01 | Applicant | |
| CN101571887 | 2009-11-01 | Applicant | |
| CN101587659 | 2009-11-01 | Applicant | |
| CN102083580 | 2011-06-01 | Applicant | |
| CN102202836 | 2011-09-01 | Applicant | |
| CN202053009 | 2011-11-01 | Applicant | |
| CN203503228 | 2014-03-01 | Applicant | |
| CN103871279 | 2014-06-01 | Applicant | |
| DE2833638 | 1980-02-01 | Applicant | |
| DE3046634 | 1984-01-01 | Applicant | |
| DE3244307 | 1984-05-01 | Applicant | |
| DE3522581 | 1987-01-01 | Applicant | |
| DE4037879 | 1991-06-01 | Applicant | |
| DE19615069 | 1997-10-01 | Applicant | |
| DE19739720 | 1998-10-01 | Applicant | |
| DE19834205 | 2000-02-01 | Applicant | |
| DE20009543 | 2001-08-01 | Applicant | |
| DE102005047204 | 2007-04-01 | Applicant | |
| DE102006048165 | 2008-01-01 | Applicant | |
| DE102010038902 | 2012-02-01 | Applicant | |
| EP8527 | 1980-03-01 | Applicant | |
| EP108599 | 1984-05-01 | Applicant | |
| EP127299 | 1984-12-01 | Applicant | |
| EP145891 | 1985-06-01 | Applicant | |
| EP319623 | 1990-10-01 | Applicant | |
| EP352986 | 1998-07-01 | Applicant | |
| EP1527852 | 2005-05-01 | Applicant | |
| EP1905533 | 2008-04-01 | Applicant | |
| ES2274736 | 2007-05-01 | Applicant | |
| FR1456780 | 1965-03-01 | Applicant | |
| FR2827066 | 2003-01-01 | Applicant | |
| FR2926660 | 2009-07-01 | Applicant | |
| GB1455972 | 1976-11-01 | Applicant | |
| GB1511608 | 1978-05-01 | Applicant | |
| GB2254172 | 1992-09-01 | Applicant | |
| GB2435838 | 2007-09-01 | Applicant | |
| GB2454232 | 2009-05-01 | Applicant | |
| JP2-224877 | 1990-09-01 | Applicant | |
| JP5-329645 | 1993-12-01 | Applicant | |
| JP7-047471 | 1995-02-01 | Applicant | |
| JP7-232270 | 1995-09-01 | Applicant | |
| JP8-505091 | 1996-04-01 | Applicant | |
| JP8-150476 | 1996-06-01 | Applicant | |
| JP8-132274 | 1998-05-01 | Applicant | |
| JP2000-167666 | 2000-06-01 | Applicant | |
| JP2002278670 | 2002-09-01 | Applicant | |
| JP2003-200372 | 2003-07-01 | Applicant | |
| JP2003-326362 | 2003-11-01 | Applicant | |
| JP2004025270 | 2004-01-01 | Applicant | |
| JP2006-006604 | 2006-01-01 | Applicant | |
| JP2006-281270 | 2006-10-01 | Applicant | |
| JP2007-290025 | 2007-11-01 | Applicant | |
| JP2009-500178 | 2009-01-01 | Applicant | |
| JP2009-160636 | 2009-07-01 | Applicant | |
| JP2001-071140 | 2011-03-01 | Applicant | |
| JP2012024867 | 2012-02-01 | Applicant | |
| KR20090010693 | 2009-01-01 | Applicant | |
| RU527045 | 1995-07-01 | Applicant | |
| RU2317183 | 2008-02-01 | Applicant | |
| RU2008108601 | 2009-11-01 | Applicant | |
| SU10388963 | 1983-08-01 | Applicant | |
| WO98/45078 | 1998-10-01 | Applicant | |
| WO1/12376 | 2001-02-01 | Applicant | |
| WO1/43910 | 2001-06-01 | Applicant | |
| WO1/58400 | 2001-08-01 | Applicant | |
| WO2004/029549 | 2004-04-01 | Applicant | |
| WO2005/102230 | 2005-11-01 | Applicant | |
| WO2005/110658 | 2005-11-01 | Applicant | |
| WO2006/034571 | 2006-04-01 | Applicant | |
| WO2007/039278 | 2007-04-01 | Applicant | |
| WO2009/060231 | 2009-05-01 | Applicant | |
| WO2009/120921 | 2009-10-01 | Applicant | |
| WO2009/149740 | 2009-12-01 | Applicant | |
| WO2010/000003 | 2010-01-01 | Applicant | |
| WO2010/044982 | 2010-04-01 | Applicant | |
| WO2010/091493 | 2010-08-01 | Applicant | |
| WO2011045654 | 2011-04-01 | Applicant | |
| WO2011/058433 | 2011-05-01 | Applicant | |
| WO2011/059502 | 2011-05-01 | Applicant | |
| WO2011/067447 | 2011-06-01 | Applicant | |
| WO2011/097035 | 2011-08-01 | Applicant | |
| WO2012/016851 | 2012-02-01 | Applicant | |
| WO2012/082105 | 2012-06-01 | Applicant | |
| WO2012/143327 | 2012-10-01 | Applicant | |
| WO2013/014202 | 2013-01-01 | Applicant | |
| WO2013/061518(A1) | 2013-05-01 | Applicant | |
| WO2013/114189 | 2013-08-01 | Applicant | |
| WO2013/119749 | 2013-08-01 | Applicant | |
| WO2013/175079 | 2013-11-01 | Applicant | |
| WO2013/186413 | 2013-12-01 | Applicant | |
| WO2014/007830 | 2014-01-01 | Applicant | |
| WO2014/019045 | 2014-02-01 | Applicant | |
| WO2014/020386 | 2014-02-01 | Applicant | |
| WO2014/140720 | 2014-09-01 | Applicant | |
| WO2014/184710 | 2014-11-01 | Applicant |
Non-Patent Literature (255)
- Juan Vicenete Rosell Gonzales, “RV-Sold: simulator virtual para la formacion de soldadores”; Deformacion Metalica, Es. vol. 34, No. 301, Jan. 1, 2008.Applicant
- The Goodheart-Wilcox Co., Inc., Weld Joints and Weld Types, Chapter 6, pp. 57-68, date unknown.Applicant
- Graham, Texture Mapping, Carnegie Mellon University Class 15-462 Computer Graphics, Lecture 10, 53 pages, dated Feb. 13, 2003.Applicant
- Guu et al.,Technique for Simultaneous Real-Time Measurements of Weld Pool Surface Geometry and Arc Force, Welding Research Supplement—pp. 473-482, Dec. 1992.Applicant
- Hillis et al., “Data Parallel Algorithms”, Communications of the ACM, Dec. 1986, vol. 29, No. 12, p. 1170.Applicant
- Response to Office Action dated Nov. 14, 2014 from U.S Appl. No. 13/543,240 dated Mar. 13, 2015.Applicant
- Hirche et al., Hardware Accelerated Per-Pixel Displacement Mapping, 8 pages, 2004.Applicant
- Hu et al., Heat and mass transfer in gas metal arc welding. Part 1: the arc, found in ScienceDirect, International Journal of Heat and Mass Transfer 50 (2007), 14 pages, 833-846 Available online on Oct. 24, 2006, http://www.web.mst.edu/˜tsai/publications/HU-IJHMT-2007-1-60.pdf.Applicant
- Aidun et al., Influence of Simulated High-g on the Weld Size of Al-Li Alloy, Acta Astronautica, vol. 48, No. 2-3, pp. 153-156, 2001.Applicant
- Jonsson et al., Simulation of Tack Welding Procedures in Butt Joint Welding of Plates Welding Research Supplement, Oct. 1985, pp. 296-302.Applicant
- Kemppi ProTrainer, product data, 3 pages, printed Jan. 14, 2015.Applicant
- Konstantinos Nasios (Bsc), Improving Chemical Plant Safety Training Using Virtual Reality, Thesis submitted to the University of Nottingham for the Degree of Doctor of Philosophy, 313 pages, Dec. 2001.Applicant
- Leap Motion, Inc., product information, copyright 2013, 14 pages.Applicant
- Learning Labs, Inc., Seabery, Soldamatic Augmented Reality Welding Trainers, 4 pgs., printed Mar. 20, 2014.Applicant
- Lim et al., “Automatic classification of weld defects using simulated data and MLP neural network”, Insight, vol. 49, No. 3, Mar. 2007.Applicant
- Wade, Human uses of ultrasound: ancient and modern Department of Electrical and Computer Engineering, University of California at Santa Barbara 93106, USA. Ultrasonics (Impact Factor: 1.81). Apr. 2000; 38(1-8):1-5.Applicant
- Production Monitoring 2 brochure, four (4) pages, The Lincoln Electric Company, May 2009.Applicant
- The Lincoln Electric Company; CheckPoint Production Monitoring brochure; four (4) pages; http://www.lincolnelectric.com/assets/en—US/products/literature/s232.pdf; Publication S2.32; Issue Date Feb. 2012.Applicant
- Lincoln Electric, VRTEX Virtual Reality Arc Welding Trainer, 9 pgs. Printed Feb. 2, 2014.Applicant
- Lincoln Electric, Vrtex 360 Virtual Reality Arc Welding Trainer, 4 pgs., Oct. 2014.Applicant
- Linholm et al., “NVIDIA Testla: A Unifired Graphics and Computing Architecture”, IEEE Computer Society, 2008.Applicant
- Mahrle et al., “The influence of fluid flow phenomena on the laser beam welding process”, Intl. J. of Heat and Fluid Flow, 23, pp. 288-297 (2002).Applicant
- Mann et al., Realtime HDR (High Dynamic Range) Video for Eyetap Wearable Computers, FPGA-based Seeing Aids, and Glasseyes (Eyetaps), 2012 25th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 1-6, 6 pages, Apr. 29, 2012.Applicant
- Yosh Mantinband et al., Autosteroscopic, field—sequential display with full freedom of movement OR Let the display were the shutter—glasses, yosh©3ality.com, (Israel) Ltd., 8 pages, 2002.Applicant
- Mavrikios et al., A prototype virtual reality-based demonstrator for immersive and interactive simulation of welding processes, International Journal of Computer Integrated manufacturing, Taylor and Francis, Basingstoke, GB, vol. 19, No. 3, Apr. 1, 2006, pp. 294-300.Applicant
- Mechanisms and Mechanical Devices Sourcebook, Chironis, McGraw Hill, Neil Sclater, 2nd Ed. 1996.Applicant
- Miller Electric Mfg. Co., “LiveArc Welding Performance Management System”, 4 pg. brochure, Dec. 2014.Applicant
- Miller Electric, Owner's Manual, Live Arc, Welding Performance Management System, Owners's Manual—OM-267 357A; 64 pgs., Jul. 2014.Applicant
- Miller Electric Mfg. Co., MIG Welding System features weld monitoring software; NewsRoom 2010 (Dialog® File 992); © 2011 Dialog. 2010; http://www.dialogweb.com/cgi/dwclient?reg=1331233430487; three (3) pages; printed Mar. 8, 2012.Applicant
- N. A. Tech., P/NA.3 Process Modeling and Optimization, 11 pages, Jun. 4, 2008.Applicant
- NSRP ASE, Low-Cost Virtual Reality Welder Training System, 1 Page, 2008.Applicant
- NVIDIA Tesla: A Unified Graphics and Computing Architecture, IEEE Computer Society 0272-1732, Mar.-Apr. 2008.Applicant
- O'Brien, “Google's Project Glass gets some more details”,Jun. 27, 2012, Retrieved from the Internet: http://www.engadget.com/2012/06/27/googles-project-glass-gets-some-more-details/, 1 page, retrieved on Sep. 26, 2014.Applicant
- Porter et al., Virtual Reality Training, Paper No. 2005-P19, 14 pages, 2005.Applicant
- Porter et al., Virtual Reality Welder Training, 29 pages, dated Jul. 14, 2006.Applicant
- Porter, Virtual Reality Welder Trainer, Session 5: Joining Technologies for Naval Applications: earliest date Jul. 14, 2006 (http://weayback.archive.org), Edision Welding Institute; J. Allan Cote, General Dynamics Electric Boat; Timothy D. Gifford, VRSim, and Wim Lam, FCS Controls.Applicant
- Praxair, “The RealWeld Trainer System”, two page brochure, 2013.Applicant
- Ratnam et al.: “Automatic classification of weld defects using simulated data and an MLP neutral network.” Insight vol. 49, No. 3; Mar. 2007.Applicant
- Reeves, “Particles Systems—A Technique for Modeling a Class of Fuzzy Objects”, Computer Graphics 17:3 pp. 359-376, 1983, 17 pages.Applicant
- Rodjito, Position tracking and motion prediction using Fuzzy Logic, 81 pages, 2006, Colby College, Honors Theses, Paper 520.Applicant
- Russell et al., “Artificial Intelligence: A Modem Approach”, Prentice-Hall (Copyright 1995).Applicant
- Schoder, “Design and Implementation of a Video Sensor for Closed Loop Control of Back Bead Weld Puddle Width,” Massachusetts Institute of Technology, Dept. of Mechanical Engineering, May 27, 1983.Applicant
- Seabury Soluciones, SOLDMATIC Welding Trainer Simulator, 30 pages, printed Jan. 14, 2015.Applicant
- SIMFOR / CESOL, “RV-Sold” Welding Simulator, Technical and Functional Features, 20 pages, no date available.Applicant
- Sim Welder, Train better welders faster, retrieved on Apr. 12, 2010 from: http://www.simwelder.com.Applicant
- Training in a virtual environment gives welding students a leg up, retrieved on Apr. 12, 2010 from: http://www.thefabricator.com/article/arcwelding/virtually-welding.Applicant
- Teeravarunyou et al., “Computer Based Welding Training System”, Intl J of Industrial Engineering, 16 (2), pp. 116-125 (2009).Applicant
- Veiga, Simulation of a Work Cell in the IGRIP Program, dated 2006, 50 pages.Applicant
- ViziTech USA, Changing the Way America Learns, retrieved on Mar. 27, 2014 from http://vizitechusa.com/, 2 pages.Applicant
- International Search Report and Written Opinion from PCT/IB2009/006605 dated Feb. 12, 2010.Applicant
- International Search Report and Written Opinion from PCT/IB10/02913 dated Apr. 19, 2011.Applicant
- International Search Report and Written Opinion from PCT/IB2014/002346 dated Feb. 24, 2015.Applicant
- International Search Report and Written Opinion from PCT/IB2015/000161 dated Jun, 8, 2015.Applicant
- International Search Report and Written Opinion from PCT/IB2015/000257 dated Jul. 3, 2015.Applicant
- Notice of Allowance from U.S. Appl. No. 13/543,240 dated Jun. 3, 2015.Applicant
- 16th International Ship and Offshore Structures Congress : Aug. 20-25, 2006; Southhampton, U.K. vol. 2 Specialist Committee V.3 Fabrication Technology Committee Mandate: T. Borzecki, G. Bruce, Y.S. Han, M. Heinermann, A. Imakita, L. Josefson, W. Nie, D. Olsen, F. Roland and Y. Takeda. Naval Ship Design, ABS Papers 2006.Applicant
- Abbas et al., Code Aster (Software) EDF (France), 29 pages, Oct. 2001.Applicant
- Abbas et al., Code—Aster; Introduction to Code—Aster; User Manual; Booklet U1.0-: Introduction to Code—Aster; Document: U1.02.00; Version 7.4; Jul. 22, 2005.Applicant
- Abid et al., “Numerical Simulation to study the effect of tack welds and root gap on welding deformations and residual stresses of a pipe flange joint” Intl. J. of Pressure Vessels and Piping, 82, pp. 860-871 (2005).Applicant
- Abida et al., Numerical simulation to study the effect of tack welds and root gap on welding deformations and residual stresses of a pipe-flange joint, Faculty of Mechanical Engineering, GIK Institute of Engineering Sciences and Technology, Topi, NWFP, Pakistan, 12 pages, Available on-line Aug. 25, 2005.Applicant
- Agren, Sensor Integration for Robotic Arc Welding; 1995; vol. 5604C of Dissertations Abstracts International p. 1123; Dissertation Abs Online (Dialog® File 35): © 2012 ProQuest Info& Learning: http://dialogweb.com/cgi/dwclient?req=1331233317524; one (1) page; printed Mar. 8, 2012.Applicant
- Aidun et al., “Penetration in Spot GTA Welds during Centrifugation,” Journal of Materials Engineering and Performance Volumn 7(5) Oct. 1998—597-600.Applicant
- ANSI/A WS D 10.11 MID 10. 11 :2007 Guide for Root Pass Welding of Pipe without Backing Edition: 3rd American Welding Society / Oct. 13, 2006 /36 pages ISBN: 0871716445, 6 pages.Applicant
- Antonelli et al., “A Semi-Automated Welding Station Exploiting Human-robot Interaction”, Dept. of Production Systems and Economics, pp. 249-260, 2011.Applicant
- Arc+ simulator; 2 pgs., http://www.123arc.com/en/depliant—ang.pdf; 2000.Applicant
- asciencetutor.com, A division of Advanced Science and Automation Corp., VWL (Virtual Welding Lab), 2 pages, 2007.Applicant
- ASME Definitions, Consumables, Welding Positions, dated Mar. 19, 2001 See http://www.gowelding.com/wp/asme4.htm.Applicant
- B. Virtual Reality Welder Trainer, Session 5, joining Technologies for Naval Applications, earliest date Jul. 14, 2006 (Nancy Porter of EWI).Applicant
- Balijepalli et al., “A Haptic Based Virtual Grinding Tool”, Haptic Interfaces for Virtual Environment and Teleoperator Systems, Haptics 2003, 7-.,Department of Mechanical & Aerospace Engineering, State University of New York at Buffalo, NY.Applicant
- Borzecki et al., Specialist Committe v.3 Fabrication Technology Comittee Mandate, Aug. 20-25, 2006, 49 pages, vol. 2, 16th International Ship and Offshore Structures Congress, Southampton, UK.Applicant
- Boss (engineering), Wikipedia, 1 page, printed Feb. 6, 2014.Applicant
- ChemWeb.com, Journal of Materials Engineering and Performance (v.7, #5), 3 pgs., printed Sep. 26, 2012.Applicant
- Chen et al., Self-Learning Fuzzy Neural Networks and Computer Vision for Control of Pulsed GTAW, Welding Research Supplement, pp. 201-209, dated May 1997.Applicant
- Choquet, “ARC+: Today's Virtual Reality Solution for Welders” Internet Page, Jan. 1, 2008, 6 pages.Applicant
- Code Aster (Software) EDF (France), Oct. 2001.Applicant
- Cooperative Research Program, Virtual Reality Welder Training, Summary Report SR 0512, 4 pages, Jul. 2005.Applicant
- CS Wave, The Virtual Welding Trainer, 6 pages, 2007.Applicant
- CS Wave, A Virtual learning tool for welding motion, 10 pages, Mar. 14, 2008.Applicant
- CS Wave, Product Description, 2 pages, printed Jan. 14, 2015.Applicant
- Desroches, Code-Aster, Note of use for calculations of welding; Instruction manual U2.03 booklet: Thermomechanical; Document: U2.03.05; Oct. 1, 2001.Applicant
- D'huart et al., Virtual Environment for Training: An Art of Enhancing Reality, 6th International Conference, ITS 20002, Biarritz, France and San Sebastian, Spain, 6 pages, Jun. 2002.Applicant
- Dotson, Augmented Reality Welding Helmet Prototypes How Awesome the Technology Can Get, Sep. 26, 2012, Retrieved from the Internet: URL:http://siliconangle.com/blog/2012/09/26/augmented-reality-welding-helmet-prototypes-how-awesome-the-technology-can-get/,1 page, retrieved on Sep. 26, 2014.Applicant
- Echtler et al., “The Intelligent Welding Gun: Augmented Reality of Experimental Vehicle Construction”, Virtual and Augmented Reality Applications in Manufacturing, 17, pp. 1-27, Springer Verlag, 2003.Applicant
- Edison Welding Institute, E-Weld Predictor, 3 pages, 2008.Applicant
- Eduwelding+, Weld Into the Future; Online Welding Seminar—A virtual training environment; 123arc.com; 4 pages, 2005.Applicant
- Eduwelding+, Training Activities with arc+ simulator; Weld Into the Future, Online Welding Simulator—A virtual training environment; 123arc.com; 6 pages, May 2008.Applicant
- Erden, “Skill Assistance with Robot for Manual Welding”, Marie Curie Intra-European Fellowship, Project No. 297857, 3 pgs., printed Apr. 27, 2015.Applicant
- EWM Virtual Welding Trainer, 2 pages, printed Jan. 14, 2015.Applicant
- The Fabricator, Virtually Welding, Training in a virtual environment gives welding students a leg up, 4 pages, Mar. 2008.Applicant
- Fast et al., “Virtual Training for Welding”, Mixed and Augmented Reality, 2004, ISMAR 2004, Third IEEE and CM International Symposium on Arlington, VA, Nov. 2-5, 2004.Applicant
- Fillet weld, Wikipedia, 3 pgs. Printed Feb. 6, 2014.Applicant
- Fronius, ARS Electronica Linz GMBH, High-speed video technology is applied to research on welding equipment, and the results are visualized in the CAVE, 2 pages, May 18, 1997.Applicant
- Fronius, Virtual Welding, 8 pages, printed Jan. 14, 2015.Applicant
- Joanneum, Fronius—virtual welding, 2 pages, May 12, 2008.Applicant
- Fronius, Virtual Welding/The Welder Training of the Future/, 8 page brochure, 2011.Applicant
- Garcia-Allende et al.; Defect Detection in Arc-Welding Processes by Means of the Line-to-Continuum Method and Feature Selection; www.mdpi.com/journal/sensors; Sensors 2009, 9, 7753-7770; doi; 10.3390/s91007753.Applicant
- International Search Report and Written Opinion from PCT/US10/60129 dated Feb. 10, 2011.Applicant
- International Search Report and Written Opinion from PCT/US12/45776 dated Oct. 1, 2012.Applicant
- Office Action from U.S. Appl. No. 12/499,687 dated Oct. 16, 2012.Applicant
- International Preliminary Report on Patentability from PCT/IB2014/001796 dated Mar. 15, 2016.Applicant
- Wang et al., “Numerical Analysis of Metal Transfer in Gas Metal Arc Welding,” Departments of Mechanical and Electrical Engineering. University of Kentucky, Dec. 12, 2001.Applicant
- Wang et al., “Numerical Analysis of Metal Transfer in Gas Metal Arc Welding Under Modified Pulsed Current conditions,” Metallurgical and Materials Transactions B, vol. 35B, Oct. 2004, pp. 857-866.Applicant
- Wang et al., Study on welder training by means of haptic guidance and virtual reality for arc welding, 2006 IEEE International Conference on Robotics and Biomimetics, ROBIO 2006 ISBN-10: 1424405718, p. 954-958.Applicant
- Weld nut, Wikipedia, 2 pgs. Printed Feb. 6, 2014.Applicant
- Weldplus, Welding Simulator, 2 pages, printed Jan. 14, 2015.Applicant
- White et al., Virtual welder trainer, 2009 IEEE Virtual Reality Conference, p. 303, 2009.Applicant
- Chuansong Wu, “Microcomputer-based welder training simulator”, Computers in Industry, vol. 20, No. 3, Oct. 1992, pp. 321-325, XP000205597, Elsevier Science Publishers, Amsterdam, NL.Applicant
- Wuhan Onew Technology Co., Ltd., “Onew Virtual Simulation Expert”, 16 pgs., printed Apr. 16, 2015.Applicant
- Yao et al., ‘Development of a Robot System for Pipe Welding’. 2010 International Conference on Measuring Technology and Mechatronics Automation. Retrieved from the Internet: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5460347&tag=1; pp. 1109-1112, 4 pages.Applicant
- EnergynTech Inc., Advanced Metals Processing Technology & Flexible Automation for Manufacturing; Virtual Welder; Virtual training system for beginning welders; website printout; http://www.energyntech.com; 2 page; 2014.Applicant
- EnergynTech Inc., Zipper Robot Performing a HiDep Weld; website printout; http://www.energyntech.com/Zipper.html; 1 page; 2014.Applicant
- Terebes, Project Motivation Problems Using Traditional Welding Masks; Institute of Automation; University of Bremen; 2 page; 2015.Applicant
- WeldWatch Software/Visible Welding; website printout; http://visiblewelding.com/weldwatch-software/; 4 pages; 2015.Applicant
- Products/Visible Welding; Weldwatch Video Monitoring System; website prinout http://visible welding.com/products; 4 pages; 2015.Applicant
- NSRP—Virtual Welding—A Low Cost Virtual Reality Welder Training System—Phase II—Final Report; Feb. 29, 2012; Kenneth Fast, Jerry Jones, Valerie Rhoades; 53 pages.Applicant
- corrected Notice of Allowance from U.S. Appl. No. 12/966,570 dated Feb. 23, 2015.Applicant
- Office Action from U.S. Appl. No. 14/444,173 dated Mar. 18, 2015.Applicant
- Response to Office Action dated Mar. 18, 2015 from U.S. Appl. No. 14/444,173 dated Jun. 11, 2015.Applicant
- Notice of Allowance from U.S. Appl. No. 14/444,173 dated Jun. 24, 2015.Applicant
- Response from U.S. Appl. No. 12/499,687 dated Apr. 10, 2013.Applicant
- Office Action from U.S. Appl. No. 12/499,687 dated Jun. 26, 2013.Applicant
- Response from U.S. Appl. No. 12/499,687 dated Nov. 25, 2013.Applicant
- Office Action from U.S. Appl. No. 12/499,687 dated Mar. 6, 2014.Applicant
- Response from U.S. Appl. No. 12/499,687 dated Sep. 5, 2014.Applicant
- Office Action from U.S. Appl. No. 12/499,687 dated Nov. 6, 2014.Applicant
- Office Action from U.S. Appl. No. 12/966,570 dated May 8, 2013.Applicant
- Response from U.S. Appl. No. 12/966,570 dated Oct. 8, 2013.Applicant
- Notice of Allowance from U.S. Appl. No. 12/966,570 dated Apr. 29, 2014.Applicant
- Office Action from U.S. Appl. No. 13/543,240 dated Nov. 14, 2014.Applicant
- Notice of Allowance from U.S. Appl. No. 13/543,240 dated Sep. 3, 2015.Applicant
- International Search Report and Written Opinion from PCT/IB2015/000777 dated Sep. 21, 2015.Applicant
- International Search Report and Written Opinion from PCT/IB2015/000814 dated Nov. 5, 2015.Applicant
- International Search Report and Written Opinion from PCT/IB2015/001711 dated Jan. 4, 2016.Applicant
- Narayan et al., “Computer Aided Design and Manufacturing,” pp. 3-4, 14-15, 17-18, 92-95, and 99-100, Dec. 31, 2008.Applicant
- Office Action from Chinese Application No. 201480027306.4 dated Aug. 3, 2016.Applicant
- Office Action from Chinese Application No. 201280075678.5 dated Jul. 5, 2016.Applicant
- Office Action from Chinese Application No. 201380017661.9 dated Aug. 22, 2016.Applicant
- International Preliminary Report on Patentability from PCT/IB2015/000161 dated Aug. 25, 2016.Applicant
- International Preliminary Report on Patentability from PCT/IB2015/000257 dated Sep. 15, 2016.Applicant
- Office Action from Chinese Application No. 201480025359.2 dated Sep. 29, 2016.Applicant
- Office Action from U.S. Appl. No. 14/190,812 dated Nov. 9, 2016.Applicant
- Office Action from U.S. Appl. No. 14/293,700 dated Dec. 28, 2016.Applicant
- Office Action from U.S. Appl. No. 14/293,826 dated Dec. 30, 2016.Applicant
- Exhibit B from Declaration of Morgan Lincoln in Lincoln Electric Co. et al. v. Seabery Soluciones, S.L. et al., Case No. 1:15-cv-01575-DCN, dated Dec. 20, 2016, 5 pages.Applicant
- International Search Report and Written Opinion from PCT/IB2015/000777 dated Dec. 15, 2016.Applicant
- International Search Report and Written Opinion from PCT/IB2015/000814 dated Dec. 15, 2016.Applicant
- “High Performance Computer Architectures: A Historical Perspective,” downloaded May 5, 2016, http://homepages.inf.ed.ac.uk/cgi/mi/comparch. pl?Paru/perf.html, Paru/perf-f.html, Paru/menu-76.html, 3 pages.Applicant
- Aiteanu et al., “Generation and Rendering of a Virtual Welding Seam in an Augmented Reality Training Environment,” Proceedings of the Sixth IASTED International Conference on Visualization, Imaging and Image Processing, Aug. 28-30, 2006, 8 pages, allegedly Palma de Mallorca, Spain. Ed. J.J. Villaneuva. ACTA Press.Applicant
- Tschimer et al., “A Concept for the Application of Augmented Reality in Manual Gas Metal Arc Welding,” Proceedings of the International Symposium on Mixed and Augmented Reality; 2 pages; 2002.Applicant
- Penrod, “New Welder Training Tools,” EWI PowerPoint presentation, 16 pages, allegedly 2008.Applicant
- Fite-Georgel, “Is there a Reality in Industrial Augmented Reality?” 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 10 pages, allegedly 2011.Applicant
- Hillers et al., “Real time Arc-Welding Video Observation System,” 62nd International Conference of IIW, Jul. 12-17, 2009, 5 pages, allegedly Singapore 2009.Applicant
- Advance Program of American Welding Society Programs and Events, Nov. 11-14, 2007, 31 pages, Chicago.Applicant
- Terebes, examples from http://www.terebes.uni-bremen.de., 6 pages.Applicant
- Sandor et al., “PAARTI: Development of an Intellegent Welding Gun for BMW,” PIA2003, 7 pages, Tokyo, 2003.Applicant
- ARVIKA Forum Vorstellung Projekt PAARI, BMW Group Virtual Reality Center, 4 pages, Nuernberg, 2003.Applicant
- Sandor et al., “Lessons Learned in Designing Ubiquitous Augmented Reality User Interfaces,” 21 pages, allegedly from Emerging Technologies of Augmented Reality: Interfaces Eds. Haller, M.; Billinghurst, M.; Thomas, B. Idea Group Inc., 2006.Applicant
- Impact Welding: examples from current and archived website, trade shows, etc. See, e.g., http://impactwelding.com, 53 pages.Applicant
- http://www.nsrp.org/6-Presentations/WDVirtual—Welder.pdf (Virtual Reality Welder Training, Project No. SI051, Navy ManTech Program, Project Review of Ship Tech 2005), 22 pages, Biloxi, MS.Applicant
- https://app.aws—org/w/r/www/wj/2005/031WJ—2005—03.pdf (AWS Welding Journal, Mar. 2005 (see, e.g., p. 54))., 114 pages.Applicant
- https://app.aws.org/conferences/defense/live index.html (AWS Welding in the Defense Industry conference schedule, 2004), 12 pages.Applicant
- https://app.aws.org/wj/2004/04/052/njc (AWS Virtual Reality Program to Train Welders for Shipbuilding, workshop information, 2004), 7 pages.Applicant
- https://app.aws.org/wj/2007/11WJ200711.pdf (AWS Welding Journal, Nov. 2007), 240 pages.Applicant
- American Welding Society, “Vision for Welding Industry,” 41 pages.Applicant
- Energetics, Inc. “Welding Technology Roadmap,” Sep. 2000, 38 pages.Applicant
- Aiteanu et al., “Computer-Aided Manual Welding Using an Augmented Reality Supervisor,” Sheet Metal Welding Conference XII, Livonia, MI, May 9-12, 2006, 14 pages.Applicant
- Hillers et al., “Augmented Reality—Helmet for the Manual Welding Process,” Institute of Automation, University of Bremen, Germany, 21 pages.Applicant
- Aiteanu et al., “A Step Forward in Manual Welding: Demonstration of Augmented Reality Helmet” Institute of Automation, University of Bremen, Germany, Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality; 2003, 2 pages.Applicant
- ArcSentry, “Weld Quality Monitoring System,” Native American Technologies, allegedly 2002, 5 pages.Applicant
- P/NA.3, “Process Modelling and Optimization,” Native American Technologies, allegedly 2002, 5 pages.Applicant
- Hillers et al., “Terebes: Welding Helmet with AR Capabilities,” Institute of Automatic University Bremen; Institute of Industrial Engineering and Ergonomics, 10 pages, allegedly 2004.Applicant
- Sheet Metal Welding Conference XII, American Welding Society Detroit Section, May 2006, 11 pages.Applicant
- Fast et al., “Virtual Training for Welding,” Proceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2004), 2 pages.Applicant
- Amended Answer to Complaint with Exhibit A filed by Seabery North America Inc. in Lincoln Electric Co. et al. v. Seabery Soluciones, S.L. et al., Case No. 1:15-cv-01575-DCN, doc. No. 44, filed Mar. 1, 2016, in the U.S. District Court for the Northern District of Ohio, 19 pages.Applicant
- Amended Answer to Complaint with Exhibit A filed by Seabery Soluciones SL in Lincoln Electric Co. et al. v. Seabery Soluciones, S.L. et al., Case No. 1:15-cv-01575-DCN, doc. No. 45, filed Mar. 1, 2016, in the U.S. District Court for the Northern District of Ohio, 19 pages.Applicant
- Reply to Amended Answer to Complaint for Patent Infringement filed by Lincoln Electric Co., Lincoln Global, Inc. in Lincoln Electric Co. et al. v. Seabery Soluciones, S.L. et al., Case No. 1:15-cv-01575-DCN, doc. No. 46, filed Mar. 22, 2016, in the U.S. District Court for the Northern District of Ohio, 5 pages.Applicant
- Answer for Patent Infringement filed by Lincoln Electric Company, Lincoln Global, Inc. in Lincoln Electric Co. et al. v. Seabery Soluciones, S.L. et al., Case No. 1:15-cv-01575-DCN, doc. No. 47, filed Mar. 22, 2016, in the U.S. District Court for the Northern District of Ohio, 5 pages.Applicant
- Petition for Inter Partes Review of U.S. Pat. No. 8,747,116, IPR 2016-00749, Apr. 7, 2016; 70 pages.Applicant
- Petition for Inter Partes Review of U.S. Pat. No. RE45,398, IPR 2016-00840, Apr. 18, 2016, 71 pages.Applicant
- Petition for Inter Partes Review of U.S. Pat. No. 9,293,056, IPR 2016-00904, May 9, 2016, 91 pages.Applicant
- Petition for Inter Partes Review of U.S. Pat. No. 9,293,057, IPR 2016-00905, May 9, 2016, 87 pages.Applicant
- http://www.vrsim.net/history, downloaded Feb. 26, 2016, 10:04:37 pm.Applicant
- Complaint for Patent Infringement in Lincoln Electric Co. et al. v. Seabery Soluciones, S.L. et al., Case No. 1:15-cv-01575-DCN, doc. No. 1, filed Aug. 10, 2015, in the U.S. District Court for the Northern District of Ohio, 81 pages.Applicant
- Kobayashi et al., “Simulator of Manual Metal Arc Welding with Haptic Display,” Proc. of the 11th International Conf. on Artificial Reality and Telexistence (ICAT), Dec. 5-7, 2001, pp. 175-178, Tokyo, Japan.Applicant
- Wahi et al., “Finite-Difference Simulation of a Multi-Pass Pipe Weld,” vol. L, paper Mar. 1, International Conference on Structural Mechanics in Reactor Technology, San Francisco, CA, Aug. 15-19, 1977.Applicant
- Declaration of Dr. Michael Zyda, May 3, 2016, exhibit to IPR 2016-00749.Applicant
- Declaration of Edward Bohnert, Apr. 27, 2016, exhibit to IPR 2016-00749.Applicant
- Swantec corporate web page downloaded Apr. 19, 2016, http://www.swantec.com/technology/numerical-simulation/.Applicant
- Catalina et al., “Interaction of Porosity with a Planar Solid/Liquid Interface,” Metallurgical and Materials Transactions, vol. 35A, May 2004, pp. 1525-1538.Applicant
- Fletcher Yoder Opinion re RE45398 and U.S. Appl. No. 14/589,317, Sep. 9, 2015, 41 pages.Applicant
- Kobayashi et al., “Skill Training System of Manual Arc Welding By Means of Face Shield-Like HMD and Virtual Electrode,” Entertainment Computing, vol. 112 of the International Federation for Information Processing (IFIP), Springer Science + Business Media, New York, copyright 2003, pp. 389-396.Applicant
- G.E. Moore, “No exponential is forever: but 'Forever can be delayed!,” IEEE International Solid-State Circuits Conference, 2003, 19 pages.Applicant
- Grahn et al., “Interactive Simulation of Contrast Fluid using Smoothed Particle Hydrodynamics,” Jan. 1, 2008, Masters Thesis in Computing Science, Umea University, Department of Computing Science, Umea Sweden, 69 pages.Applicant
- Vesterlund et al., “Simulation and Rendering of a Viscous Fluid using Smoothed Particle Hydrodynamics,” Dec. 3, 2004, Master's Thesis in Computing Science, Umea University, Department of Computing Science, Umea Sweden; 46 pages.Applicant
- Mueller et al., “Point Based Animation of Elastic, Plastic and Melting Objects,” Eurographics/ACM SIGGRAPH Symposium on Computer Animation (2004), 11 pages.Applicant
- Nealen, “Point-Based Animation of Elastic, Plastic, and Melting Objects,” CG topics, Feb. 2005, 2 pages.Applicant
- Tonnesen, “Modeling Liquids and Solids using Thermal Particles,” Proceedings of Graphics Interface 1991, pp. 255-262, Calgary, Alberta, 1991.Applicant
- Cuda, “Programming Guide Version 1.1,” Nov. 29, 2007, 143 pages.Applicant
- Websters II new college dictionary, 3rd ed., Houghton Mifflin Co., copyright 2005, Boston, MA, p. 1271, definition of Wake, 3 pages.Applicant
- Da Dallo et al., “CS Wave: Learning welding motion in a virtual environment ,” published in Proceedings of the IIW International Conference, Jul. 10-11, 2008, 19 pages.Applicant
- CS Wave-Manual, “Virtual Welding Workbench User Manual 3.0,” 2007, 25 pages.Applicant
- Choquet, “ARC+®: Today's Virtual Reality Solution for Welders,” published in Proceedings of the IIW International Conference, Jul. 10-11, 2008, 19 pages.Applicant
- Welding Handbook, Welding Science & Technology, American Welding Society, Ninth Ed., Copyright 2001, Appendix A, “Terms and Definitions,” 54 pages.Applicant
- “Virtual Welding: A Low Cost Virtual Reality Welder Training System,” NSRP RA 07-01-BRP Oral Review Meeting in Charleston, SC at ATI, Mar. 2008, 6 pages.Applicant
- Aiteanu, “Virtual and Augmented Reality Supervisor for A New Welding Helmet,” Dissertation Nov. 15, 2005, 154 pages.Applicant
- Screen Shot of CS Wave Exercise 135.FWPG Root Pass Level 1 https://web.archive.org/web/20081128081858/http:/wave.c-s.fr/images/english/snap—evolution2.Jpg, 1 page.Applicant
- Screen Shot of CS Wave Control Centre V3.0.0 https://web.archive.org/web/20081128081915/http:/wave.c-s.fr/images/english/snap—evolution4.jpg, 1 page.Applicant
- Screen Shot of CS Wave Control Centre V3.0.0 https://web.archive.org/web/20081128081817/http:/wave.c-s.fr/images/english/snap—evolution6.jpg, 1 page.Applicant
- Da Dalto et al. “CS Wave A Virtual learning tool for the welding motion,” Mar. 14, 2008, 10 pages.Applicant
- Nordruch et al., “Visual Online Monitoring of PGMAW Without a Lighting Unit,” Jan. 2005, 14 pages.Applicant
- Tamasi, “The Evolution of Computer Graphics,” NVIDIA, 2008, 36 pages.Applicant
- VRSim Powering Virtual Reality, www.lincolnelectric.com/en-us/eguipment/Iraining-eguipment/Pages/powered-by-'rsim.aspx, 2016, 1 page.Applicant
- Hillers et al., “Direct welding arc observation without harsh flicker,” 8 pages, allegedly FABTECH International and AWS welding show, 2007.Applicant
- Declaration of Dr. Michael Zyda, May 3, 2016, exhibit to IPR 2016-00905, 72 pages.Applicant
- Declaration of Edward Bohnart, Apr. 27, 2016, exhibit to IPR 2016-00905, 23 pages.Applicant
- Declaration of Dr. Michael Zyda, May 3, 2016, exhibit to IPR 2016-00904, 76 pages.Applicant
- Declaration of Edward Bohnart, Apr. 27, 2016, exhibit to IPR 2016-00904, 22 pages.Applicant
- Declaration of Axel Graeser, Apr. 17, 2016, exhibit to IPR 2016-00840, 88 pages.Applicant
- ARC+ -Archived Press Release from WayBack Machine from Jan. 31, 2008-Apr. 22, 2013, https://web.3rchive.org/web/20121006041803/http://www.123certification.com/en/article—press/index.htm, downloaded on Jan. 21, 2016, 3 pages.Applicant
- Tschimer et al., “Virtual and Augmented Reality for Quality Improvement of Manual Welds,” National Institute of Standards and Technology, Jan. 2002, Publication 973, 24 pages.Applicant
- Wang et al., “Impingement of Filler Droplets and Weld Pool During Gas Metal Arc Welding Process,” International Journal of Heat and Mass Transfer, Sep. 1999, 14 pages.Applicant
- Jeffus, “Welding Principles and Applications,” Sixth Edition, 2008, 10 pages.Applicant
- Renwick et al., “Experimental Investigation of GTA Weld Pool Oscillations,” Welding Research—Supplement to the Welding Journal, Feb. 1983, 7 pages.Applicant
- Phar, “GPU Gems 2 Programming Techniques for High-Performance Graphics and General-Purpose Compulation,” 2005, 12 pages.Applicant
- Office Action from U.S. Appl. No. 14/526,914 dated Feb. 3, 2017.Applicant
- International Preliminary Report on Patentability from PCT/IB2015/000158 dated Jan. 26, 2017.Applicant
- Adams et al., “Adaptively Sampled Particle Fluids,” ACM Transactions on Graphics, vol. 26, No. 3, Article 48, Jul. 2007, pp. 48.1-48.7.Applicant
- Bargteil et al., “A Texture Synthesis Method for Liquid Animations,” Eurographics/ACM SIGGRAPH Symposium on Computer Animation, 2006, pp. 345-351.Applicant
- Bargteil et al., “A Semi-Lagrangian Contouring Method for Fluid Simulation,” ACM Transactions on Graphics, vol. 25, No. 1, Jan. 2006, pp. 19-38.Applicant
- Chentanez et al., “Liquid Simulation on Lattice-Based Tetrahedral Meshes,” Eurographics/ACM SIGGRAPH Symposium on Computer Animation, 2007, 10 pages.Applicant
- Chentanez et al., “Simultaneous Coupling of Fluids and Deformable Bodies,” Eurographics/ACM SIGGRAPH Symposium on Computer Animation, 2006, pp. 83-89.Applicant
- Clausen et al., “Simulating Liquids and Solid-Liquid Interactions with Lagrangian Meshes,” ACM Transactions on Graphics, vol. 32, No. 2, Article 17, Apr. 2013, pp. 17.1-17.15.Applicant
- Feldman et al., “Animating Suspended Particle Explosions,” Computer Graphics Proceedings, Annual Conference Series, Jul. 27-31, 2003, pp. 1-8.Applicant
- Feldman et al., “Fluids in Deforming Meshes,” Eurographics/ACM SIGGRAPH Symposium on Computer Animation, 2005, pp. 255-259.Applicant
- Foster et al., “Practical Animation of Liquids,” ACM SIGGRAPH, Aug. 12-17, 2001, Los Angeles, CA, pp. 23-30.Applicant
- Foster et al., “Realistic Animation of Liquids,” Graphical Models and Image Processing, vol. 58, No. 5, Sep. 1996, pp. 471-483.Applicant
- Goktekin et al., “A Method for Animating Viscoelastic Fluids,” Computer Graphics Proceedings, Annual Conference Series, Aug. 8-12, 2004, pp. 1-6.Applicant
- Holmberg et al., “Efficient Modeling and Rendering of Turbulent Water over Natural Terrain,” Proceedings of the 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, Singapore, Jun. 15-18, 2004, pp. 15-22.Applicant
- Irving et al., “Efficient Simulation of Large Bodies of Water by Coupling Two and Three Dimensional Techniques,” ACM Transactions on Graphics (TOG), vol. 25, Issue 3, Jul. 2006, pp. 805-811.Applicant
- Kass et al., “Rapid, Stable Fluid Dynamics for Computer Graphics,” Computer Graphics, vol. 24, No. 4, Aug. 1990, pp. 49-57.Applicant
- Klinger et al., “Fluid Animation with Dynamic Meshes,” Computer Graphics Proceedings, Annual Conference Series, Jul. 30-Aug. 3, 2006, pp. 820-825.Applicant
- Muller et al., “Particle-Based Fluid Simulation for Interactive Applications,” Eurographics/SIGGRAPH Symposium on Computer Animation (2003), pp. 154-159 and 372.Applicant
- O'Brien et al., “Dynamic Simulation of Splashing Fluids,” Proceedings of Computer Animation, Apr. 19-21, 1995, Geneva, Switzerland, pp. 198-205.Applicant
- Premoze et al., “Particle-Based Simulation of Fluids,” EUROGRAPHICS, vol. 22, No. 3, 2003. 10 pages.Applicant
- Rasmussen et al., “Directable Photorealistic Liquids,” Eurographics/ACM SIGGRAPH Symposium on Computer Animation, 2004, pp. 193-202.Applicant
- Stam, “Stable Fluids,” SIGGRAPH 99 Conference Proceedings, Annual Conference Series, Aug. 1999, pp. 121-128.Applicant
- Thurey et al., “Real-time Breaking Waves for Shallow Water Simulations,” Proceedings of the Pacific Conference on Computer Graphics and Applications, Maui, HI Oct. 29-Nov. 2, 2007, 8 pages.Applicant
- International Preliminary Report on Patentability from PCT/IB2015/001084 dated Jan. 26, 2017.Applicant
- Office Action from U.S. Appl. No. 14/190,812 dated Feb. 23, 2017.Applicant
- Office Action from U.S. Appl. No. 14/552,739 dated Feb. 17, 2017.Applicant
- Xie et al., “A Real-Time Welding Training System Base on Virtual Reality,” Wuhan Onew Technology Co., Lid, IEEE Virtual Reality Conference 2015, Mar. 23-27, Arles France, pp. 309-310.Applicant
- Office Action from U.S. Appl. No. 14/615,637 dated Apr. 27, 2017.Applicant
- Office Action from Chinese Application No. 201480025359.2 dated Feb. 28, 2017.Applicant
- Office Action from Chinese Application No. 201380076368.X dated Mar. 1, 2017.Applicant
- Yaoming, “Applications of Microcomputer in Robot Technology,” Scientific and Technical Documentation Press, Sep. 1987, pp. 360-365.Applicant