CA2709394A1 - Video scene change detection - Google Patents

Abstract

A selective encryption encoder consistent with certain embodiments of the invention has vertical and/or horizontal stripes encrypted. In one embodiment, packets are examined in the digital video signal to identify a specified packet type, the specified packet type being packets carrying data representing a video slice wherein the video slice contains a larger amount of data than a threshold (or a subsequent slice). The packets identified as being of the specified packet type are encrypted using a first encryption method to produce first encrypted packets.
These first encrypted packets are then used to replace the unencrypted packets in the digital video signal to produce a partially encrypted video signal. The packets of the specified type can also be multiple encrypted and replaced in the data stream to produce a multiple encrypted video data stream.

Description

CROSS REFERENCE TO RELATED DOCUMENTS
11 This application is related to patent applications docket number 12 SNY-R4646.01 entitled "Critical Packet Partial Encryption" to Unger et al., serial number 13 10/038,217; patent applications docket number SNY-R4646.02 entitled "Time Division 14 Partial Encryption" to Candelore et al., serial number 10/038,032; docket number SNY-R4646.03 entitled "Elementary Stream Partial Encryption" to Candelore,serial number 16 10/037,914; docket number SNY-R4646.04 entitled "Partial Encryption and PID
Mapping"
17 to Unger at al., serial number 10/037,499; and docket number SNY-R4646.05 entitled 18 "Decoding and Decrypting of Partially Encrypted Information" to Unger et al., serial number 19 10/037,498 all of which were filed on January 2, 2002..
21 This application is also related to and claims priority benefit of U.S.
22 Provisional patent application serial number 60/409,675 filed September 9, 23 to Candelore, et al. entitled "Generic PID Remapping for Content Replacement", 24 Docket No. 50S5152.

27 A portion of the disclosure of this patent document contains material which 28 is subject to copyright protection. The copyright owner has no objection to the 29 facsimile reproduction of the patent document or the patent disclosure, as it 1 appears in the Patent and Trademark Office patent file or records, but otherwise 2 reserves all copyright rights whatsoever.

This invention relates generally to the field of encryption. More particularly, 6 this invention relates to a encryption method and apparatus particularly useful for 7 scrambling packetized video content such as that provided by cable and satellite 8 television systems.

BACKGROUND OF THE INVENTION
11 The above-referenced commonly owned patent applications describe 12 inventions relating to various aspects of methods generally referred to herein as 13 partial encryption or selective encryption. More particularly, systems are described 14 therein wherein selected portions of a particular selection of digital content are encrypted using two (or more) encryption techniques while other portions of the 16 content are left unencrypted. By properly selecting the portions to be encrypted, the 17 content can effectively be encrypted for use under multiple decryption systems 18 without the necessity of encryption of the entire selection of content. In some 19 embodiments, only a few percent of data overhead is needed to effectively encrypt the content using multiple encryption systems. This results in a cable or satellite 21 system being able to utilize Set-top boxes or other implementations of conditional 22 access (CA) receivers from multiple manufacturers in a single system - thus freeing 23 the cable or satellite company to competitively shop for providers of Set-top boxes.

BRIEF DESCRIPTION OF THE DRAWINGS
26 The features of the invention believed to be novel are set forth with 27 particularity in the appended claims. The invention itself however, both as to 28 organization and method of operation, together with objects and advantages 29 thereof, may be best understood by reference to the following detailed description 1 of the invention, which describes certain exemplary embodiments of the invention, 2 taken in conjunction with the accompanying drawings in which:
3 FIGURE 1 is a block diagram of an exemplary cable system head end 4 consistent with certain embodiments of the present invention.

5- FIGURE 2 is an illustration of sample transport stream PSI consistent with 6 certain embodiments of the present invention.

7 FIGURE 3 is a further illustration of sample transport stream PSI consistent 8 with certain embodiments of the present invention.

9 FIGURE 4 is a block diagram of an illustrative control processor 100 consistent with certain embodiments of the present invention.
11 FIGURE 5 illustrates the slice structure of a frame of video data consistent 12 with certain embodiments of the present invention.
13 FIGURE 6 is a flow chart depicting a slice size based scene change 14 detection process used in conjunction with an encryption process consistent with certain embodiments of the present invention.
16 FIGURE 7 is a flow chart depicting another slice size based scene change 17 detection process used in conjunction with an encryption process consistent with 18 certain embodiments of the present invention.
19 FIGURE 8 is a flow chart depicting an infra-coded macroblock count based scene change detection process used in conjunction with an encryption process 21 consistent with certain embodiments of the present invention.
22 FIGURE 9 is a flow chart depicting another intra-coded macroblock count 23 based scene change detection process used in conjunction with an encryption 24 process consistent with certain embodiments of the present invention.
FIGURE 10 is a flow chart depicting a packet count based scene change 26 detection process used in conjunction with an encryption process consistent with 27 certain embodiments of the present invention.

1 FIGURE 11 is a flow chart depicting another packet count based scene 2 change detection process used in conjunction with an encryption process 3 consistent with certain embodiments of the present invention.
4 FIGURE 12 illustrates a television Set-top box that decrypts and decodes in a manner consistent with certain embodiments of the present invention.
6 FIGURE 13 is a flow chart broadly illustrating an encryption process 7 consistent with embodiments of the present invention.

While this invention is susceptible of embodiment in many different forms, 11 there is shown in the drawings and will herein be described in, detail specific 12 embodiments, with the understanding that the present disclosure is to be 13 considered as an example of the principles of the invention and not intended to limit 14 the invention to the specific embodiments shown and described. In the description below, like reference numerals are used to describe the same, similar or 16 corresponding parts in the several views of the drawings.
17 The terms "scramble" and "encrypt" and variations thereof are used 18 synonymously herein. Also, the term "television program" and similar terms can 19 be interpreted in the normal conversational sense, as well as a meaning wherein the term means any segment of A/V content that can be displayed on a television 21 set or similar monitor device. The term "video" is often used herein to embrace not 22 only true visual information, but also in the conversational sense (e.g., "video tape 23 recorder") to embrace not only video signals but associated audio and data.
The 24 term "legacy" as used herein refers to existing technology used for existing cable and satellite systems. The exemplary embodiments disclosed herein are decoded 26 by a television Set-Top Box (STB), but it is contemplated that such technology will 27 soon be incorporated within television receivers of all types whether housed in a 28 separate enclosure alone or in conjunction with recording and/or playback 29 equipment or Conditional Access (CA) decryption module or within a television set 1 itself. The present document generally uses the example of a "dual partial 2 encryption" embodiment, but those skilled in the art will recognize that the present 3 invention can be utilized to realize multiple partial encryption without departing from 4 the invention. Partial encryption and selective encryption are used synonymously herein.
6 Turning now to FIGURE 1, a head end 100 of a cable television system 7 suitable for use in practicing a dual encryption embodiment of the present invention 8 is illustrated. Those skilled in the art will appreciate that the present invention could 9 also be implemented using more than two encryptions systems without departing from the present invention. The illustrated head end 100 implements the dual 11 partial encryption scenario of the present invention by adapting the operation of a 12 conventional encryption encoder 104 (such as those provided by Motorola, Inc. and 13 Scientific-Atlanta, Inc., and referred to herein as the primary encryption encoder) 14 with additional equipment.
Head end 100 receives scrambled content from one or more suppliers, for 16 example, using a satellite dish antenna 108 that feeds a satellite receiver 110.
17 Satellite receiver 110 operates to demodulate and descramble the incoming 18 content and supplies the content as a stream of clear (unencrypted) data to a 19 selective encryption encoder 114. The selective encryption encoder 114, according to certain embodiments, uses two passes or two stages of operation, to encode the 21 stream of data. Encoder 114 utilizes a secondary conditional access system (and 22 thus a second encryption method) in conjunction with the primary encryption 23 encoder 104 which operates using a primary conditional access system (and thus 24 a primary encryption method). A user selection provided via a user interface on a control computer 118 configures the selective encryption encoder 114 to operate 26 in conjunction with either a Motorola or Scientific Atlanta cable network (or other 27 cable or satellite network).
28 It is assumed, for purposes of the present embodiment of the invention, that 29 the data from satellite receiver 110 is supplied as MPEG (Moving Pictures Expert Group) compliant packetized data. In the first stage of operation the data is passed 1 through a Special Packet Identifier (PID) 122. Special Packet Identifier 122 2 identifies specific programming that is to be dual partially encrypted according to 3 the present invention. The Special Packet Identifier 122 signals the Special Packet 4 Duplicator 126 to duplicate special packets. The Packet Identifier (P1D) Remapper 130, under control of the computer 118, to remap the PIDs of the elementary 6 streams (ES) (i.e., audio, video, etc.) of the programming that shall remain clear 7 and the duplicated packets to new PID values. The payload of the elementary 8 stream packets are not altered in any way by Special Packet Identifier 122, Special 9 Packet Duplicator 126, or PID remapper 1306. This is done so that the primary encryption encoder 104 will not recognize the clear unencrypted content as content 11 that is to be encrypted.
12 The packets may be selected by the special packet identifier 122 according 13 to one of the selection criteria described in the above-referenced applications or 14 may use another selection criteria such as those which will be described later herein. Once these packets are identified in the packet identifier 122, packet 16 duplicator 126 creates two copies of the packet. The first copy is identified with the 17 original PID so that the primary encryption encoder 104 will recognize that it is to 18 be encrypted. The second copy is identified with a new and unused PID, called 19 a "secondary PID" (or shadow PlD) by the PID Remapper 122_ This secondary PID
will. be used later by the selective encryption encoder 114 to determine which 21 packets are to be encrypted according to the secondary encryption method.
22 FIGURE 2 illustrates an exemplary set of transport PSI tables 136 after this 23 remapping with a PAT 138 defining two programs (10 and 20) with respective PID
24 values 0100 and 0200. A first PMT 140 defines a PID=0101 for the video elementary stream and P1Ds 0102 and 0103 for two audio streams for program 10.
26 Similarly, a second PMT 142 defines a PID=0201 for the video elementary stream 27 and PIDs 0202 and 0203 for two audio streams for program 20.
28 As previously noted, the two primary commercial providers of cable head 29 end encryption and modulation equipment are (at this writing) Motorola, Inc. and Scientific-Atlanta, Inc. While similar in operation, there are significant differences 1 that should be discussed before proceeding since the present selective encryption 2 encoder 114 is desirably compatible with either system. In the case of Motorola 3 equipment, the Integrated. Receiver Transcoder (IRT), an unmodulated output is 4 available and therefore there is no need to demodulate the output before returning a signal to the selective encryption encoder 114, whereas no such unmodulated 6 output is available in a Scientific-Atlanta device. Also, in the case of current 7 Scientific-Atlanta equipment, the QAM, the primary encryption encoder carries out 8 a PID remapping function on received packets. Thus, provisions are made in the 9 selective encryption encoder 1.14 to address this remapping.
In addition to the above processing, the Program Specific Information (PSI) 11 is also modified to reflect this processing. The original, incoming Program 12 Association Table (PAT) is appended with additional Program Map Table (PMT) 13 entries at a PMT inserter 134. Each added PMT entry contains the new, additional 14 streams (remapped & shadow PIDs) created as part of the selective encryption (SE) encoding process for a corresponding stream in a PMT of the incoming 16 transport. These new PMT entries will mirror their corresponding original PMTs.
17 The program numbers will be automatically assigned by the selective encryption 18 encoder 114 based upon open, available program numbers as observed from the 19 program number usage in the incoming stream. The selective encryption System 114 system displays the inserted program information (program numbers, etc) on 21 the configuration user interface of control computer 118 so that the Multiple System 22 Operator (MSO, e.g., the cable system operator) can add these extra programs into 23 the System Information (SI) control system and instruct the system to carry these 24 programs in the clear.
The modified transport PSI is illustrated as 144 in FIGURE 3 with two 26 additional temporary PMTs 146 and 148 appended to the tables of transport PSI
27 136. The appended PMTs 146 and 148 are temporary. They are used for the 28 primary encryption process and are removed in the second pass of processing by 29 the secondary encryption encoder. In accordance with the MPEG standard, all entries in the temporary PMTs are marked with stream type "user private" with an 1 identifier of OxFO. These PMTs describe the remapping of the PIDs for use in later 2 recovery of the original mapping of the PIDs in the case of a PID remapping in the 3 Scientific-Atlanta equipment. Of course, other identifiers could be used without 4 departing from the present invention.
In order to assure that the Scientific-Atlanta PID remapping issue is 6 addressed, if the selective encryption encoder 114 is configured to operate with a 7 Scientific-Atlanta system, the encoder adds a user private data descriptor to each 8 elementary stream found in the original PMTs in the incoming data transport 9 stream (TS) per the format below (of course, other formats may also be suitable):

Syntax value # of bits private-data _indicator descriptorQ {
descriptor tag OxFO 8 descriptor length 0x04 8 private_data_indicatorO {
orig_pid Ox???? 16 stream-type Ox?? 8 reserved OxFF 8 }
}
11 The selective encryption encoder 114 of the current embodiment also adds 12 a user private data descriptor to each elementary stream placed in the temporary 13 PMTs created as described above per the format below:

Syntax value # of bits private-data _indicator descriptorQ {
descriptor tag OxFO 8 descriptor length 0x04 8 private-data _indicatorO {
orig_pid Ox???? 16 stream_type Ox?? 8 reserved OxFF 8 }
}

2 The "???" in the tables above is the value of the "orig_pid" which is a variable 3 while the "??" is a "stream_type" value. The data field for "orig_pid" is a variable 4 that contains the original incoming PID or in the case of remap or shadow PIDs, the original PID that this stream was associated with. The data field "stream type" is 6 a variable that describes the purpose of the stream based upon the chart below:

9 Stream Type Value Legacy ES Ox00 Remapped ES Ox01 11 Shadow ES 0x02 Reserved 0x03 - OxFF

14 These descriptors will be used later to re-associate the legacy elementary streams, which are encrypted by the Scientific-Atlanta, Inc. primary encryption 16 encoder 104, with the corresponding shadow and remapped clear streams after 17 PID remapping in the Scientific-Atlanta, Inc. modulator prior to the second phase 18 of processing of the Selective Encryption Encoder. Those skilled in the art will 19 appreciate that the above specific values should be considered exemplary and other specific values could be used without departing from the present invention.
21 In the case of a Motorola cable system being selected in the selective 22 encryption encoder configuration GUI, the original PAT and PMTs can remain 23 unmodified, providing the system does not remap PIDs within the primary 24 encryption encoder. The asterisks in FIGURE 1 indicate functional blocks that are not used in a Motorola cable system.
26 The data stream from selective encryption encoder 114 is passed along to 27 the input of the primary encryption encoder 104 which first carries out a PID filtering 28 process at 150 to identify packets that are to be encrypted. At 152, in the case of 29 a Scientific-Atlanta device, a PID remapping may be carried out. The data are then passed-along to an encrypter 154 that, based upon the PID of the packets encrypts 1 certain packets (in accord with the present invention, these packets are the special 2 packets which are mapped by the packet duplicator 130 to the original PID of the 3 incoming data stream for the current program). The remaining packets are 4 unencrypted. The data then passes through a PSI modifier 156 that modifies the PSI data to reflect changes made at the PID remapper. The data stream is then 6 modulated by a quadrature amplitude modulation (QAM) modulator 158 (in the 7 case of the Scientific-Atlanta device) and passed to the output thereof.
This 8 modulated signal is then demodulated by a QAM demodulator 160. The output of 9 the demodulator 160 is directed back to the selective encryption encoder 114 to a PSI parser164.
11 The second phase of processing of the transport stream for selective 12 encryption is to recover the stream after the legacy encryption process is carried 13 out in the primary encryption encoder 104. The incoming Program Specific 14 Information (PSI) is parsed at 164 to determine the PIDs of the individual elementary streams and their function for each program, based upon the 16 descriptors attached in the first phase of processing. This allows for the possibility 17 of PID remapping, as seen in Scientific-Atlanta primary encryption encoders. The 18 elementary streams described in the original program PMTs are located at PSI
19 parser 164 where these streams have been reduced to just the selected packets of interest and encrypted in the legacy CA system format in accord with the primary 21 encryption method at encoder 104. The elementary streams in the temporary 22 programs appended to the original PSI are also recovered at elementary stream 23 concatenator 168. The packets in the legacy streams are appended to the 24 remapped content, which is again remapped back to the PID of the legacy streams, completing the partial, selective encryption of the original elementary streams.
26 The temporary PMTs and the associated PAT entries are discarded and 27 removed from the PSI. The user private data descriptors added in the first phase 28 of processing are also removed from the remaining original program PMTs in the 29 PSI. For a Motorola system, no PMT or PAT reprocessing is required and only the final secondary encryption of the transport stream occurs.

1 During the second phase of processing, the SE encoder 114 creates a 2 shadow PSI structure that parallels the original MPEG PSI, for example, having at 3 PAT origin at PID 0x0000. The shadow PAT will be located at a PID specified in 4 the SE encoder configuration as indicated by the MSO from the user interface. The shadow PMT PIDs will be automatically assigned by the SE encoder 114 6 dynamically, based upon open, available PID locations as observed from PID
7 usage of the incoming stream. The PMTs are duplicates of the original PMTs, but 8 also have CA descriptors added to the entire PMT or to the elementary streams 9 referenced within to indicate the standard CA parameters and optionally, shadow PID and the intended operation upon the associated elementary stream. The CA

11 descriptor can appear in the descriptorl () or descriptor2() loops of the shadow 12 PMT. If found in descriptorl (),the CA_PID called out in the CA descriptor contains 13 the non-legacy ECM PID which would apply to an entire program.
Alternatively, the 14 ECM PID may be sent in descriptor2(). The CA descriptor should not reference the selective encryption elementary PID in the descriptorl () area.

CA PID Definition Secondary CA private data Value ECM PID Ox00 Replacement PID Ox01 Insertion PID 0x02 ECM PID undefined (default) 18 This shadow PSI insertion occurs regardless of whether the selective 19 encryption operation is for a Motorola or Scientific Atlanta cable network.
The elementary streams containing the duplicated packets of interest that were also 21 assigned to the temporary PMTs are encrypted during this second phase of 22 operation at secondary packet encrypter in the secondary CA format based upon 23 the configuration data of the CA system attached using the DVB (Digital Video 24 Broadcasting) SimulcryptTM standard.

1 The data stream including the clear data, primary encrypted data, secondary 2 encrypted data and other-information are then passed to a PSI modifier 176 that 3 modifies the transport PSI information by deletion of the temporary PMT
tables and 4 incorporation of remapping as described above. The output of the PSI
modifier 176 is modulated at a QAM modulator 180 and delivered to the cable plant 184 for 6 distribution to the cable system's customers.
7 The control processor 100 may be a personal computer based device that 8- is used to control the selective encryption encoder as described herein. An 9 exemplary personal computer based controller 100 is depicted in FIGURE 4.
Control processor 100 has a central processor unit (CPU) 210 with an associated 11 bus 214 used to connect the central processor unit 210 to Random Access Memory 12 218 and Non-Volatile Memory 222 in a known manner. An output mechanism at 13 226, such as a display and possibly printer, is provided in order to display and/or 14 print output for the computer user as well as to provide a user interface such as a Graphical User Interface (GUI). Similarly, input devices such as keyboard and 16 mouse 230 may be provided for the input of information by the user at the MSO.
17 Computer 100 also may have disc storage 234 for storing large amounts of 18 information including, but not limited to, program files and data files.
Computer 19 system 100 also has an interface 238 for connection to the selective encryption encoder 114. Disc storage 234 can store any number of encryption methods that 21 can be downloaded as desired by the MSO to vary the encryption on a regular 22 basis to thwart hackers. Moreover, the encryption methods can be varied 23 according to other criteria such as availability of bandwidth and required level of 24 security.
The partial encryption process described above utilizes any suitable 26 conditional access encryption method at encrypters 154 and 174. However, these 27 encryption techniques are selectively applied to the data stream using a technique 28 such as those described below or in the above-referenced patent applications. In 29 general, but without the intent to be limiting, the selective encryption process utilizes intelligent selection of information to encrypt so that the entire program 1 does not have to undergo dual encryption. By appropriate selection of appropriate 2 data to encrypt, the program material can be effectively scrambled and hidden from 3 those who desire to hack into the system and illegally recover commercial content 4 without paying- The MPEG (or similar format) data that are used to represent the audio and video data does so using a high degree of reliance on the redundancy 6 of information from frame to frame. Certain data can be transmitted as "anchor"
7 data representing chrominance and luminance data. That data is then often simply 8 moved about the screen to generate subsequent frames by sending motion vectors 9 that describe the movement of the block. Changes in the chrominance and luminance data are also encoded as changes rather than a recoding of absolute 11 anchor data.
12 In accordance with certain embodiments of the present invention, a method 13 of dual encrypting a digital video signal involves examining unencrypted packets of 14 data in the digital video signal to identify at least one specified packet type, the specified packet type comprising packets of data as will be described hereinafter;
16 encrypting packets identified as being of the specified packet type using a first 17 encryption method to produce first encrypted packets; encrypting the packets 18 identified as being of the specified packet type using a second encryption method 19 to produce second encrypted packets; and replacing the unencrypted packets of the specified packet type with the first encrypted packets and the second encrypted 21 packets in the digital video signal to produce a partially dual encrypted video signal.
22 The MPEG specification defines a slice as "... a series of an arbitrary number 23 of consecutive macroblocks. The first and last macroblocks of a slice shall not be 24 skipped macroblocks. Every slice shall contain at least one macroblock.
Slices shall not overlap. The position of slices may change from picture to picture.
The 26 first and last macroblock of a slice shall be in the same horizontal row of 27 macroblocks. Slices shall occur in the bitstream in the order in which they are 28 encountered, starting at the upper-left of the picture and proceeding by raster-scan 29 order from left to right and top to bottom...."

1 By way of example, to represent an entire frame of NTSC information, for 2 standard resolution, the frame (picture) is divided into 30 slices (but in general j 3 slices may make up a full frame). Each slice contains 33 variable length 4 macroblocks (but in general can include k variable length macroblocks) of information representing a 16x16 pixel region of the image. This is illustrated as 6 standard definition frame 250 of FIGURES with each slice starting with a slice 7 header (SH1-SH30) and each slice having 33 macroblocks (MB1-MB33). By 8 appropriate selection of particular data representing the frame, the image can be 9 scrambled beyond recognition in a number of ways as will be described below.
By variation of the selection criteria for selective encryption, hackers can be thwarted 11 on a continuing basis. Moreover, the selection criteria can be changed to adapt to 12 bandwidth requirements as well as need for security of particular content (or other 13 criteria).

SCENE CHANGE DETECTION
16 In accordance with one embodiment consistent with the invention referred 17 to herein as "scene change detection encryption", scene changes are used as a 18 criterion for selection of data to be encrypted. Whenever a scene change takes 19 place in-a digital video signal (e.g., an MPEG digital video signal), there is generally an inability to rely upon prior anchor data such as absolute luminance and 21 chrominance data that is generally transmitted in I Frames or P Frames.
22 Essentially, a new starting point image is created for the image. From this starting 23 point, high degrees of compression can be obtained by use of motion vectors to 24 describe movement of the images. The starting point image is essentially a first frame of the scene change and contains large amounts of intra-coded data. As 26 previously described, this data is coded as intra-coded macroblocks within the 27 slices of video data (video slices).
28 Thus, during a scene change, the MPEG encoder sends intra-coded 29 information (containing absolute luminance and chrominance information).

1 Ordinarily, the encoder attempts to send this data in an I Frame or I slices (for a 2 progressive refresh P Frame). However, the timing of a scene change may dictate 3 that the encoder must encode this data in other frames and other slices. The data 4 can be sent in either of two ways, either as intra-coded macroblocks or as motion vector macroblocks with luminance and chrominance error correction data (called 6 macroblock pattern). In either case, the amount of data will generally significantly 7 exceed the norm (although, in general, the amount of data needed to encode 8 luminance and chrominance data is more than that needed to encode motion 9 vector information).
The first frame of a scene change thus generally contains large amounts of 11 intra-coded data compared with the data required to define a change in the image 12 from frame to frame when a scene change is not taking place. This fact provides 13 a basis for detection of a scene change. By establishment of a threshold, it can be 14 defined that a scene change, for purposes of this invention, takes place whenever the amount of data in a particular frame or slice exceeds this prescribed threshold.
16 The threshold can, in this example, correspond to a number of bits or bytes making 17 up a particular slice (or frame or other suitable segment of the image) of data. In 18 one exemplary embodiment, using a 3 Mbps test stream, it is noted that a slice of 19 standard definition video data generally carries between about 376 and 752 bits of video data. By observation of the amount of data that constitutes a scene change, 21 a threshold of approximately 1316 bits, which is I '/ to 3 times the nominal size, 22 can be established empirically and refined. The size of the slices will vary with the 23 stream bit rate and nature of the content. For example, whether there are a lot of 24 hard cuts or action scenes in the video. Thus any absolute bit size cannot be conclusive of a scene change. However, in one example consistent with certain 26 embodiments of the present invention, a rule could be made that if the slice size 27 were 1 1/2 to 3 times the size of previous slices, then a scene change is occurring.
28 Thus, it can be deemed that any slice carrying more than this threshold contains 29 data representing a scene change. This slice, and/or the following slice (to capture 1 additional scene change information carried in a subsequent slice) can be 2 encrypted to provide partial encryption of the video image.
3 When a decoder (such as one incorporated within special packet identifier 4 128) receives the MPEG encoded digital video stream, it can therefore use the size of a data slice as an indication of a scene change. If the decoder is able to buffer 6 one or more slices of the video data stream, each slice exceeding the threshold in 7 size can be encrypted in accordance with certain embodiments. of the present 8 invention. However, in the event such buffering is not available, it can be assumed 9 that a scene change will involve multiple sequential slices of video data.
Thus, if a slice exceeds the size threshold, it can reasonably be assumed that the next slice 11 will also contain a portion of the scene change. Thus, if inadequate buffering is 12 available to permit encryption of the current slice of video data (which exceeds the 13 threshold in size), the following slice can be encrypted to capture additional scene 14 change information carried in a subsequent slice to provide partial encryption of the-video image. Ideally, of course, all slices involved with the scene change will be 16 encrypted.

17 This process is depicted as process 300 of FIGURE 6 starting at 304. At 18 308 a threshold T is established as a threshold beyond which a scene change is 19 deemed to have occurred. At 312 a slice of video data is received and its size S
is determined at 316. If the slice of video data is not larger in size than the 21 threshold at 320, and if it is not the last slice in an image at 324, the process 22 increments to the next slice at 330 and control returns to 312 where the slice is 23 retrieved, If the slice size S is greater than or equal to the threshold (or 24 alternatively, simply greater than the threshold) at 320, at least a portion of the slice (e.g., the slice header or all intra-coded data in the slice or the entire slice) is 26 encrypted at 336. The process then proceeds to 324. When the last slice of the 27 video signal has been processed, process 300 ends at 340.
28 In a similar manner, a process wherein a previous slice is used to determine 29 whether or not to encrypt a current slice is depicted as process 400 of 1 starting at 404. At 408 a threshold T is established as a threshold beyond which 2 a scene change is deemed to have occurred. A first slice is received at 410 and 3 a current slice of video data is received at 412. The size S of the slice prior to the 4 current slice is determined at 416. If the prior slice of video data is not larger in size than the threshold at 420, and if it is not the last slice in an image at 424, the 6 process increments to the next slice at 430 and control returns to 412 where a new 7 current slice is retrieved. If the slice size S of the prior slice is greater than or equal 8 to the threshold (or alternatively, simply greater than the threshold) at 420, at least 9 a portion of the current slice (e.g., the slice header or all intra-coded data in the slice or the entire slice) is encrypted at 436. The process then proceeds to 424.
11 When the last slice of the video signal has been processed, process 400 ends at 12 440.
13 Those skilled in the art will also appreciate that the processes 300 and 14 can be combined so that both the current slice and the prior slice are encrypted if the prior slice is greater in size than the threshold. The slices can be encrypted in 16 any suitable manner including, but not limited to, encryption of the entire slice, 17 encryption of slice headers for the slice or encryption of all intra-coded macroblocks 18 in the slice, without limitation.
19 In addition to measuring the size of a slice (or frame or other portion of the image) by number of packets or bytes or bits, the size of the slice can be judged 21 in other ways. For example, the number size of a slice at a scene change is related 22 to the number of intra-coded macroblocks contained in the slice. Thus, in another 23 embodiment consistent with the present invention (which can be viewed as a 24 subset of the first embodiment), the size of a slice can be judged by the number of macroblocks containing intra-coded data within the slice. This process is depicted 26 as process 500 of FIGURE 8 starting at 504. At 508 a threshold T number of intra-27 coded macroblocks is established as a threshold beyond which a scene change 28 is deemed to have occurred. At 512 a slice of video data is received and its size 29 1(in terms of number of intra-coded macroblocks) is determined at 516. If the slice of video data contains fewer intra-coded macroblocks than the threshold T at 520, 1 and if it is not the last slice in an image at 524, the process increments to the next 2 slice at 530 and control returns to 512 where the slice is retrieved. If the number 3 of intra-coded macroblocks I is greater than or equal to the threshold T (or 4 alternatively, simply greater than the threshold) at 520, at least a portion of the slice (e.g., the slice header or all intra-coded data in the slice or the entire slice) is 6 encrypted at 536. The process then proceeds to 524. When the last slice of the 7 video signal has been processed, process 500 ends at 540.
8 In a similar manner, a process wherein a previous slice is used to determine 9 whether or not to encrypt a current slice is depicted as process 600 of starting at 604. At 608 a threshold T (number of intra-coded macroblocks) is 11 established as a threshold beyond which a scene change is deemed to have 12 occurred. A first slice is received at 610 and a current slice of video data is 13 received at 612. The size S of the slice prior to the current slice is determined (in 14 number of intra-coded macroblocks) at 616. If the prior slice of video data is not larger in size than the threshold at 620 (as measured in number of intra-coded 16 macroblocks), and if it is not the last slice in an image at 624, the process 17 increments to the next slice at 630 and control returns to 612 where a new current 18 slice is retrieved. If the number of intra-coded macroblocks I of the prior slice is 19 greater than or equal to the threshold T (or alternatively, simply greater than the threshold) at 620, at least a portion of the current slice (e.g., the slice header or all 21 intra-coded data in the slice or the entire slice) is encrypted at 636. The process 22 then proceeds to 624. When the last slice of the video signal has been processed, 23 process 600 ends at 640.
24 In one exemplary embodiment, it is noted that a P frame slice of standard definition video data generally carries between about 2 and 4 intra-coded 26 macroblocks of video data (out of 33 macroblocks). This varies greatly By 27 observation of the amount of data that constitutes a scene change, a threshold of 28 approximately 15 intra-coded macrobiocks can be established empirically and 29 refined. The threshold value is somewhat subjective. It can depend on the encoder.
It can also partly depend on whether or not any scenes detections can be missed.

1 There are major and minor scene changes. It is possible that only major scene 2 changes need be detected. Thus, it can be deemed that any slice carrying more 3 than this threshold contains data representing a scene change. This slice, and/or 4 the following slice can be encrypted to provide partial encryption of the video image.
6 Those skilled in the art will also appreciate that the processes 500 and 600 7 can be combined so that both the current slice and the prior slice are encrypted if 8 the prior slice is greater in size than the threshold. The slices can be encrypted in 9 any suitable manner including, but not limited to, encryption of the entire slice, encryption of slice headers for the slice or encryption of all intra-coded macroblocks 11 in the slice, without limitation.
12 In another embodiment, consistent with embodiments of the present 13 invention, the size of a slice of video can be measured in terms of the number of 14 packets required to carry the slice's data. Recall that the macroblocks of data forming a slice are variable in size. However, in most commercial embodiments, 16 the transport stream carrying the macroblocks of data is carried using fixed size 17 packets. These fixed size packets, thus, will vary in number depending upon the 18 amount of data in a particular slice of video. Therefore, the size of the video slice 19 can be gauged by the number of packets used to carry the slice of data.
Accordingly, a process 700 is depicted in FIGURE 6 starting at 704 in which the 21 number of packets is used as a measure of the size of the video slice. At 708 a 22 threshold T number of packets is established as a threshold beyond which a scene 23 change is deemed to have occurred. At 712 a slice of video data is received and 24 its size P in number of packets is determined at 716. If the slice of video data is not larger in size than the threshold T at 720 (measured in number of packets), and if 26 it is not the last slice in an image at 724, the process increments to the next slice 27 at 730 and control returns to 712 where the slice is retrieved. If the number of 28 packets P is greater than or equal to the threshold (or alternatively, simply greater 29 than the threshold) at 720, at least a portion of the slice (e.g., the slice header or all intra-coded data in the slice or the entire slice) is encrypted at 736.
The process 1 then proceeds to 724. When the last slice of the video signal has been processed, 2 process 700 ends at 740.
3 In a similar manner, a process wherein a previous slice is used to determine 4 whether or not to encrypt a current.slice is depicted as process 800 of starting at 804. At 808 a threshold T is established as a threshold beyond which 6 a scene change is deemed to have occurred. A first slice is received at 810 and 7, a current slice of video data is received at 812. The size P of the slice prior to the 8 current slice is determined (measured in number of packets) at 816. If the prior 9 slice of video data is not larger in number of packets P than the threshold T at 820, and if it is not the last slice in an image at 824, the process increments to the next 11 slice at 830 and control returns to 812 where a new current slice is retrieved. If the 12 number of packets in the slice P of the prior slice is greater than or equal to the 13 threshold T (or alternatively, simply greater than the threshold) at 820, at least a 14 portion of the slice (e.g., the slice header or all intra-coded data in the slice or the entire slice) is encrypted at 836. The process then proceeds to 824. When the last 16 slice of the video signal has been processed, process 800 ends at 840.
17 In one exemplary embodiment, it is noted that a slice of video data is 18 generally contained in between about three and eleven packets of video data. By 19 observation of the amount of data that constitutes a scene change, a threshold of approximately seven packets can be established empirically and refined. Thus, it 21 can be deemed that any slice carrying more than this threshold contains data 22 representing a scene change. This slice, and/or the following slice can be 23 encrypted to provide partial encryption of the video image. Since scene changes 24 are a relatively infrequent occurrence in a stream of video data, it generally represents a rather small (but content dependent) percentage of the overall data.
26 Encryption of such data, therefore, represents a very small percentage of overhead 27 when used in a multiple encryption environment.
28 Those skilled in the art will also appreciate that the processes 700 and 29 can be combined so that both the current slice and the prior slice are encrypted if the prior slice is greater in size than the threshold. It should be noted for purposes 1 of this discussion, that encryption of a slice of video information can be 2 accomplished in many ways. In one example, all data in the slice can be 3 encrypted. In another example, the slice header for a slice can be encrypted 4 rendering the remaining data in the slice useless and thus for practical purposes (and purposes of this document) also encrypted. Additionally, by encryption of 6 intra-coded macroblocks in a slice the slice can be effectively rendered encrypted.
7 Other possibilities may also exist consistent with embodiments of the present 8 invention.
9 Multiple combinations of the encryption techniques are possible to produce encryption that has varying bandwidth requirements, varying levels of security and 11 varying complexity. Such encryption techniques can be selected by control 12 computer 118 in accordance with the needs of the MSO. The above-described 13 encryption techniques can provide several additional choices to enrich a pallette 14 of encryption techniques that can thus be selected by control computer 118 to vary the encryption making hacking more difficult.
16 Numerous other combinations of the above encryption techniques as well 17 as those described in the above-referenced patent applications and other partial 18 encryption techniques can be combined to produce a rich pallette of encryption 19 techniques from which to select. In accordance with certain embodiments of the present invention, a selection of packets to encrypt can be made by the control 21 computer 118 in order to balance encryption security with bandwidth and in order 22 to shift the encryption technique from time to time to thwart hackers.

23 While the above embodiments describe encryption of packets containing the 24 selected data type, it is also possible to encrypt the raw data prior to packetizing without departing from this invention and such encryption is considered equivalent 26 thereto.

27 An authorized set-top box such as 900 illustrated in FIGURE 12 operating 28 under the secondary CA system decrypts and decodes the incoming program by 29 recognizing both primary and secondary PIDs associated with a single program.
The multiplexed video data stream containing both PIDs is directed to a 1 demultiplexer 904. When a program is received that contains encrypted content 2 that was encrypted by any of the above techniques, the demultiplexer directs 3 encrypted packets containing encrypted content and secondary PIDS to a 4 secondary CA decrypter 908. These packets are then decrypted at 908 and passed to a PID remapper 912. As illustrated, the PID remapper 912 receives packets that 6 are unencrypted and bear the primary PID as well as the decrypted packets having 7 the secondary PID. The PID remapper 912 combines the decrypted packets from 8 decrypter 908 with the unencrypted packets having the primary PID to produce an 9 unencrypted data stream representing the desired program. PID remapping is used to change either the primary or secondary PID or both to a single PID.
This 11 unencrypted data stream can then be decoded normally by decoder 916. Some or 12 all of the components depicted in FIGURE 12 can be implemented and/or 13 controlled as program code running on a programmed processor, with the code 14 being stored on an electronic storage medium.
FIGURE 13 is a flow chart 950 that broadly illustrates the encryption process 16 consistent with certain embodiments of the present invention starting at 954. At 17 958 the packet type that is to be encrypted is specified. In accordance with certain 18 embodiments consistent with the present invention, the selected packet type may 19 be any packet containing data that represents a first image after a scene change.
Packets are then examined at 962 to identify packets of the specified type. At 966, 21 the identified packets are duplicated and at 970 one set of these packets is 22 encrypted under a first encryption method. The other set of identified packets is 23 encrypted at 974 under a second encryption method. The originally identified 24 packets are then replaced in the data stream with the two sets of encrypted packets at 980 and the process ends at 986.
26 While the above embodiments describe encryption of packets containing the 27 selected data type, it is also possible to encrypt the raw data prior to packetizing 28 without departing from this invention and such encryption is considered equivalent 29 thereto.

1 Those skilled in the art will recognize that the present invention has been 2 described in terms of exemplary embodiments based upon use of a programmed 3 processor (e.g., processor 118, processors implementing any or all of the elements 4 of 114 or implementing any or all of the elements of 900). However, the invention should not be so limited, since the present invention could be implemented using 6 hardware component equivalents such as special purpose hardware and/or 7 dedicated processors which are equivalents to the invention as described and 8 claimed. Similarly, general purpose computers, microprocessor based computers, 9 micro-controllers, optical computers, analog computers, dedicated processors and/or dedicated hard wired logic may be used to construct alternative equivalent 11 embodiments of the present invention.
12 Those skilled in the art will appreciate that the program steps and associated 13 data used to implement the embodiments described above can be implemented 14 using disc storage as well as other forms of storage such as for example Read Only Memory (ROM) devices, Random Access Memory (RAM) devices; optical 16 storage elements, magnetic storage elements, magneto-optical storage elements, 17 flash memory, core memory and/or other equivalent storage technologies without 18 departing from the present invention. Such alternative storage devices should be 19 considered equivalents.
The present invention, as described in embodiments herein, is implemented 21 using a programmed processor executing programming instructions that are 22 broadly described above form that can be stored on any suitable electronic storage 23 medium or transmitted over any suitable electronic communication medium or 24 otherwise be present in any computer readable or propagation medium.
However, .
those skilled in the art will appreciate that the processes described above can be 26 implemented in any number of variations and in many suitable programming 27 languages without departing from the present invention. For example, the order of 28 certain operations carried out can often be varied, additional operations can be 29 added or operations can be deleted without departing from the invention.
Error trapping can be added and/or enhanced and variations can be made in user 1 interface and information presentation without departing from the present invention.
2 Such variations are contemplated and considered equivalent.
3 Software code and/or data embodying certain aspects of the present 4 invention may be present in any computer readable medium, transmission medium, storage medium or propagation medium including, but not limited to, 6 electronic storage devices such as those described above, as well as carrier 7 waves, electronic signals, data structures (e.g., trees, linked lists, tables, packets, 8 frames, etc.) optical signals, propagated signals, broadcast signals, transmission 9 media (e.g., circuit connection, cable, twisted pair, fiber optic cables, waveguides, antennas, etc.) and other media that stores, carries or passes the code and/or data.
11 Such media may either store the software code and/or data or serve to transport 12 the code and/or data from one location to another. In the present exemplary 13 embodiments, MPEG compliant packets, slices, tables and other data structures 14 are used, but this should not be considered limiting since other data structures can similarly be used without departing from the present invention.
16 While the invention has been described in conjunction with specific 17 embodiments, it is evident that many alternatives, modifications, permutations and 18 variations will become apparent to those skilled in the art in light of the foregoing 19 description. Accordingly, it is intended that the present invention embrace all such alternatives, modifications and variations as fall within the scope of the appended 21 claims.

Claims (30)

1. A method of detecting a scene change in a digital video signal, comprising:

examining a slice of the digital video signal;
determining if the slice contains a greater amount of data than a threshold amount of data;
and if the slice contains a greater amount of data than the threshold, determining that the slice forms a part of a scene change.

2. The method according to claim 1, further comprising encrypting intra-coded data at a start of the scene change.

3. The method according to claim 1, further comprising encrypting the slice of video data.

4. The method according to claim 1, further comprising encryption a slice header of the slice of video data.

5. The method according to claim 1, further comprising encrypting a subsequent slice of video data.

6. The method according to claim 1, further comprising encrypting a slice header for a subsequent slice of video data.

7. The method according to claim 1, wherein determining if the slice contains a greater amount of data than the threshold amount of data comprises counting a number of packets carrying the slice and determining if the number of packets is greater than a threshold number of packets.

8. The method according to claim 1, wherein determining if the slice contains a greater amount of data than the threshold amount of data comprises counting a number of intra-coded macroblocks in the slice and determining if the number of intra-coded macroblocks is greater than a threshold number of intra-coded macroblocks.

9. A computer readable medium storing instructions which, when executed on a programmed processor, carry out the method of scene change detection according to claim 1.

10. A method of selective encryption of a digital video signal, comprising:
detecting a scene change in the digital video signal; and encrypting at least a portion of the digital video signal carrying data representing a first image associated with the scene change.

11. The method according to claim 10, wherein the detecting comprises determining if a video slice contains a greater amount of data than a threshold amount of data, and if the video slice contains a greater amount of data than the threshold, determining that the video slice forms a part of a scene change.

12. The method according to claim 10, wherein the encrypting comprises encrypting the video slice.

13. The method according to claim 10, wherein the encrypting comprises encrypting a slice header of the video slice.

14. The method according to claim 10, wherein the encrypting comprises encrypting a subsequent video slice.

15. The method according to claim 10, wherein the encrypting comprises encrypting packets forming a part of the first image using a first encryption method to produce first encrypted packets.

16. The method according to claim 15, further comprising encrypting a duplicate of the packets forming a part of the first image using a second encryption method to produce second encrypted packets.

17. The method according to claim 16, further comprising replacing unencrypted packets with the first encrypted packets and the second encrypted packets in the digital video signal to produce a partially dual encrypted video signal.

18. The method according to claim 10, wherein the encrypting comprises encrypting intra-coded data in a first image associated with the scene change.

19. The method according to claim 10, wherein the encrypting comprises encrypting a video slice header in a first image associated with the scene change.

20. The method according to claim 10, wherein the detecting comprises counting a number of packets carrying a video slice and determining if the number of packets is greater than a threshold number of packets.

21. The method according to claim 10, wherein the detecting comprises counting a number of intra-coded macroblocks in a video slice and determining if the number of intra-coded macroblocks is greater than a threshold number of intra- coded macroblocks.

22. The method according to claim 10, wherein the detecting comprises determining if an image contains a greater amount of data than a threshold amount of data, and if the image contains a greater amount of data than the threshold, determining that the image forms a part of a scene change.

23. The method according to claim 22, wherein the image comprises a frame of video.

24. A computer readable medium storing instructions which, when executed on a programmed processor, carry out the method of encrypting a digital video signal according to claim 10.

25. A television set-top box, comprising:
a receiver receiving a digital television signal comprising:
a plurality of unencrypted packets; and a plurality of encrypted packets, wherein certain of the encrypted packets carry data representing a first image associated with the scene change;
a decrypter that decrypts the encrypted packets; and a decoder that decodes the unencrypted packets and the decrypted packets to produce a signal suitable for play on a television set.

26. A selective encryption decoder, for decrypting and decoding a selectively encrypted digital video signal, comprising:
a demultiplexer that receives packets of digital video, certain of the packets being unencrypted and certain of the packets being encrypted, wherein certain of the encrypted packets carry data representing a first image associated with the scene change;
the unencrypted packets having a first packet identifier (PID) and the encrypted packets having a second packet identifier (PID);
a decrypter receiving the encrypted packets having the second PID and decrypting the encrypted packets using a first encryption method to produce decrypted packets;
a PID remapper that changes at least one of the first and second PIDs so that the unencrypted packets and the decrypted packets have the same PID; and a decoder that decodes the unencrypted and decrypted packets to produce a decoded video signal.

27. A method of decrypting and decoding a selectively encrypted digital video signal, comprising:
receiving packets of digital video, certain of the packets being unencrypted and certain of the packets being encrypted, wherein certain of the encrypted packets carry data representing a first image associated with the scene change;
the unencrypted packets having a first packet identifier (PID) and the encrypted packets having a second packet identifier (PID);
decrypting the encrypted packets having the second PID to produce decrypted packets;
remapping at least one of the first and second PIDs so that the unencrypted packets and the decrypted packets have the same PID; and decoding the unencrypted and decrypted packets to produce a decoded video signal.

28. A computer readable medium carrying instructions which, when executed on a programmed processor, carry out the method of decrypting and decoding a digital television signal according to claim 27.

29. A computer readable medium that carries instructions that when executes on a programmed processor to facilitate operation of a video receiver device to decrypt and decode a selectively encoded digital video signal wherein the instructions comprise:

a code segment that controls a demultiplexer that receives packets of digital video, certain of the packets being unencrypted and certain of the packets being encrypted, wherein certain of the encrypted packets carry data representing a first image associated with the scene change, the unencrypted packets having a first packet identifier (PID) and the encrypted packets having a second packet identifier (PID);
a code segment that controls decryption of the encrypted packets to produce decrypted packets;
a code segment that controls remapping at least one of the first and second PIDs so that the unencrypted packets and the decrypted packets have the same PID; and a code segment that controls decoding the unencrypted and decrypted packets to produce a decoded video signal.

30. A selectively encrypted digital video signal embodied in a computer readable medium, comprising:
a sequence of packets of video data, wherein the sequence of packets when not encrypted represent a segment of video content;
wherein certain of the packets are unencrypted;
wherein certain of the packets have been produced by decrypting encrypted packets;
wherein certain of the encrypted packets carry data representing a first image associated with the scene change; and a segment of code that identifies the unencrypted packets by a first packet identifier (PID);
and a segment of code that identifies the encrypted packets by a second packet identifier (PID).