A script to help the Deaf
Hello everyone. I just found this forum while researching for a possible way to make what I've dreamed up a reality.
The reason I thought of this idea is because I'm deaf and it has to do with deaf and web videos. So I hope this is the right place to ask about this.
With video so popular on the internet it can be a little frustrating for people like me who can't enjoy it to it's fullest. Yes, some online videos have subtitles but it's still a fairly rare thing. In my searching I'd say the number of online videos that are subtitled are less then 10 percent. I can' understand why this is of course for most people aren't deaf. But there are many hard of hearing people that would benefit from subtitles as well. Not to mention subtitling videos in other languages.
So, I came up with an idea that might help people like me. It all started when I'd see friends and family watching things like TV shows on their computer. I looked around and quite often you can find the subtitles for those shows. They are usually (.SUB) or (.SRT) files. They can play with video players that have the right codec such as a DIVX player or Windows Media player. Currently the only way to add the subtitles to an online video is to Download the video and play it in a player that supports subtitles. But most sites don't allow videos to be downloaded.
So here's a solution I came up with. To help explain I made these two images.
Taken from tv.myyearbook.com
This above image is what you would see if you watch the TV show on that site.
This image above is an attempt to illustrate what I have in mind. A seperate subtitles file player with a transparent background. IT can be dragged on the screen and placed over the video and display the subtitles.
Now I realize that the transparent background might be a challenge but if that's not possible then perhaps a subtitle played that I can place below or above the video will do.
I'm not a programmer or developer. I do some graphic design work but I don't have the knowledge to make anything like this. Which is why I'm here. I'm not sure if this is the kind of forum for this kind of thing but I searched for developers and program designers in hopes that I might be able to find someone that can help.
This could also be used for personal videos as well.
Does anyone have any thoughts or advice on how I might make this idea a reality?
Thanks for your time.
I'd be interested in working with you on this project. Using .flv (Flash video) and embedding que points into the metadata would be one way to connect the video to outside captions. Another method could be to just measure the the time played in milliseconds and triggering events (captions) along the way.
Humm... sounds like a very interesting project.
Eye for Video
Thank you for the replies guys.
Let me share the thing that I have tried out. Keep in mind that I don't have much programming knowledge.
I downloaded a SRT file. For example you can find them at http://www.opensubtitles.org/en
Assuming a video is an hour long. Using windows media player I made a video that's a little over an hour long (Giving me room to adjust the timing on the subtitles if needed. This video had nothing but a black background image. To make the file smaller I converted it to a FLV video.
Now I placed that video file in the same folder as the subtitles (SRT) file and gave them the same name so the subtitles will play on the video. What I ended up with is a video that only shows the subtitles. I used Total video player because it'll play FLV files and also supports subtitles.
It's not as good as I hope it'll be but it's a start. I can make this video play any subtitles file and open the window over my browser screen. It's kind of hard to fallow though because your eye have to jump off the video to read the subtitles.
Just thought I'd share what I've tried so far. I'll look into the links you provided and see if I can understand it all.
Just a quick question... Are you looking for a video player that will play as part of a Web browser? So for example, a video with subtitles is posted on the Internet and anyone with a standard browser can play the video? or are you looking to just download the video to your local machine and then play the video in a specific video player, set up just for that purpose?
The reason I ask is that if this service to be very wide spread, you'll have to choose a video player which have Web browser pluggins available. Otherwise each and every user will have to download the specific player, then down the video file for later playback.
What I have in mind is something like this.
Go to a site such as this one and find a show you want to watch.
Then go to a site such as this one and find the subtitles file to that TV show.
Now most sites like this that you can watch TV shows or movies from (Legally) will not allow you to download their videos. So I'm thinking that if some kind of player can be made that will play subtitles files in front of a video with a transparent background. I'd just be able to open the subtitles and drag and drop it over the video that is streaming on an HTML page.
I think a big challenge will be the transparent background that plays the subtitles. If that isn't possibly then something like this image might work. Not as good but it could provide the subtitles.
I can also think of other ways this could be used other then just for deaf or heard of hearing. For example if a video is one language then you could play the subtitles in another.
How ever it could be accomplished would be great. Thanks for the offers to help out or put some thought into this. If there's anything I could do to help make this a reality let me know what I can do.
Oops. I placed the wrong image on my last post. It should be this one.
OK, I've got a better picture of the goal. A drag and drop subtitle application that can work with various Web videos.
My first thoughts are that overlaying a Web browser with another application will present problems with what’s called “focus”. That is, generally speaking, your computer will normally give one program or the other the focus, or first in line for user interaction. An example would be opening two programs, get them on your screen at the same time. To click from one to another, you have to change the focus. You see that by trying to type into the program that doesn’t have focus, etc.
Since the video is one application, the Web browser, and the caption reader on another, let’s just pretend we merged the two. Having the reader as part of the video application would greatly reduce the problems involved in creating this. So you just convince the video sites to install your new creation on their Web pages……Hey…what do you mean “Yeah right…”. It could happen you know…..????
So back to rule one of goal setting “Begin with the end in mind”. As this project develops, how about including a component that could be included on the server side.
The other branch of this project may require programming skills far beyond anything I can do…but I’ll experiment with a couple of ideas.
Let us know how this develops for you.
I would seriously advise against flash.
Flash is not native to the web browser, it has to be installed and I for one do not like flash.
Subtitling would be fairly straight forward in respect to when to display the subtitles and for how long.
If you look into video subtitle formats for media, you can then see how they use a plain text file that imposes text over the video.
... and please remember to wrap code with forum BBCode tags:-
[CODE]...[/CODE] [HTML]...[/HTML] [PHP]...[/PHP]
If you can't think outside the box, you will be trapped forever with no escape...
What do you mean by
Are you referring to the Windows Media Player as a part of IE? It’s not an integral part of other browsers so the “native” part is a bit confusing.
not native to the web browser
Other than Flash, what type of native “embedded media player” would you recommend?
Well, I've been experimenting and to be honest I almost have a possible method worked out. I stress the "Almost" because there are still some issues that I don't know how to fix.
Let me tell you what I've done. I went over it a little a couple of posts up but if you have a few minutes you can try this out yourself so you can see what issues I'm now facing.
Ok, this is the online video I found and I also found matching subtitles. Don't hold the movie against me. It's a musical and I'm deaf so I have no interest in it. LOL
Anyway, here's the online movie.
Below is a link to the hour long video I made that shows nothing but a black background. It's what the subtitles will play on. It's an FLV file and it's 65.2mb.
Right click here to download.
Now here's the Subtitles file (Extension SRT). It's a very tiny text file 95.0k.
Right click here to download the subtitles.
Place them both in the same folder. They already have the same name. So if your player supports FLV files and will show subtitles they should play on the video. If they don't then you might have to turn subtitles on on your player.
In my experience not many players that play FLV show subtitles. I use Total Video player because it does support both (It's free and I never had any problems with it.
Now I can run this video and it'll show the subtitles. Open it in front of my browser where the video is playing. and watch both. It's pretty tricky because the video also includes commercials and I have to spend some time trying to get the subtitles timed with the movie. Not an easy task when you are deaf (I sometimes need to get help with that part).
Now there are two major problems I'm having with all this. First of all it would be great if I could remove the skin of the player so it has no border around it. This would allow me to place it right below the streaming video. I see the folder that came with total video player has a "Skins" folder and the images that made the skins. I wonder if I can manipulate them.
Now I come to the biggest problem. If I can work this out I think I'd pretty much be set. Won't be the best but it would be usable. The problem is that when I shrink down the window of the total video player that's displaying the subtitles. The text on the screen also shrinks. So if I shrink it down to a size that will fit under the streaming video the text becomes too small to read.
Here are a couple of screen shots.
Like I said. Maybe there are other ways. I'm just trying to figure a way out with my limited knowledge. I appreciate all your replies.
Looks like you're making progress Ron. I understand a lot better what you are trying to do. Thanks for the images to illustrate.
Here is a thought.. can you get the .fla for the player you are using? This is the editable file for the player. Once you have that, it's possible to change what you see as a skin...slim it down..get rid of ALL the stuff that gets in the way of viewing the movie.
Lacking that…..perhaps we can create a proper video player for this purpose. Problem with the player now is that it’s set to play regular shaped videos. So create a video player specifically for subtitles.. short, squat, no extra stuff along the top of the player (File, View, Play, etc…). If controls are needed, they could be below the subtitles. Determine the exact size so you don’t have to resize when you drag below the video (what size would that be???).
I’m not sure if any players I’ve created will play subtitles…. I’ll have to look into that and try to learn a little about what that takes.
Thanks so much for looking into it. I have no idea how to make a player but I'll look around and see if I can find a place to learn.
The player will definitely need to have controls because it'll take a little work to get the subtitles lined up with the movie/show. Many of them will start at a different time then the subtitles are set to. The first line of the subtitles might start at 00:01:25 but the first line of the actual movie might start at a different time. So sometimes I might need to adjust one to match the other. I'd also have to pause the subtitles when they place commercials on the shows.
If it's a video I'd like to watch more then once. I could adjust the subtitles to match it better using a subtitles time adjuster program. So once it's set to match the video the playback will be much easier to watch the next time.
When I did some research I found that there are an estimated 28.8 million people comprise the American deaf community. My point is if I can get this to work there are people who might find this useful other then just me.
Thanks again for your help. I'm going to go see if I can learn how to manipulate my player.
Is this the file you where referring to EfV? IF so do you have any suggestion of what changes I should make. I have some HTML knowledge and can understand some of it but not all. I see there's a command "stretch" used quite often. I'm wondering if one of them would allow me to prevent the subtitles to not shrink when I shrink the player as it's playing.
Here's the code of the entire file. This was found in the "Skins" folder of the player.
Thanks again. Just thought I'd show it to see if any obvious changes can be pointed out. Ideally the player has no border. Must still have controls though (Pause, play, etc...)
Font=MS Sans Serif
Font=MS Sans Serif
MainWindow = tvp.exe,ID
PlistWindow = pls.dll,ID
AboutWindow = tvp.exe,ID
VCtrlWindow = tvp.exe,ID
NotHook = MainWindow,PlistWindow
Special = AboutWindow
FontName=MS Sans Serif
FontName=MS Sans Serif
FontName=MS Sans Serif
2=BGI_BOTTOM,268, 24, 15, 0,STRETCH,H
3=BTN_VCTRL_CYCLE,-1,3, 8, -1, BLT, H
4=BTN_VCTRL_PLAYLIST,-1,3, 34, -1, BLT, H
5=BTN_VCTRL_OPEN,-1,3, 63, -1, BLT, H
7=TXT_VCTRL_FILEINFO,270, 35, 16, 1,STRETCH,H
I use many video players that I've built myself. The code needed for a simple player is very short and straightforward. Set the doc size to short and squat... check to see how wide the typical video shows up in your browser. This player should fit in front of and just below it. So let's just say 400 wide by 60 pixels high (for two lines of subtitles plus one line of controls). You don't want to resize it. From the Library panel, far top right corner, click and open the little list box. Choose "New Video". Drag that video onto the stage. Set the video size to 400 X 40, leaving the rest of the space for the controls. Name that instance "video_screen".
Here is all the ActionScript (AS2) you need for a simple player.
It will play videos. Controls can be added fairly easily. Using a playlist will involve using an array and a little more involved AS.
var nc:NetConnection = new NetConnection();
var ns:NetStream = new NetStream(nc);
One thing I've never done is to create a player which will read the subtitle file. That will require some research.
Here are a couple of sources for good tutorials:
Hey check this out!
Go to abc.com. You can watch full episodes of TV shows and some of them have closed captions. The captions shows up in a separate table below the streaming video a lot like I'm trying to make. But this is embedded in the page (Not drag and drop such as how I want it to be). But I wonder what they are using to make it and time it to the video.
For those of you who have been looking into this with me (And I'm very thankful for your efforts). You can go there and see what I'm talking about.
To check it out go to abc.com. Click the "Episodes" link. You might have to install some plug ins to watch their videos.
If the show has closed captions you'll see a little "CC" down above the time line of the video. To make it easier to find one I know that the "Extreme makeover home edition" episodes are closed captioned. Click on "Settings" to turn closed captioning on. Then watch a few minutes of the show and you'll see how it displays the closed captions.
The above may seem like a lot of work but it really isn't. Took me about 3 minutes (including installing the plug ins).
I'd sure like to learn how they are doing it.
Users Browsing this Thread
There are currently 1 users browsing this thread. (0 members and 1 guests)