database migration can suck it

Hang out, sip some ice tea, and shoot the breeze with TR regulars.

Moderators: emkubed, Captain Ned

database migration can suck it

Postposted on Thu Apr 26, 2012 10:57 am

I'm ready to shoot someone at this stage. I don't even know who to shoot, but I'm ready to.

We moved databases a couple months back. All 25 locations statewide consolidated down to one database. Glory be, etc. Standardization is awesome, all that.

Well, our migration went kind of rough and I spent a month putting things like hours, phone numbers, locations, etc. back into the database for each organization we have in it.

This month they tried to do an export to refresh the data on the public site we maintain for Joe Public to search.

Somehow this stripped out about 1/2 the hours and a handful of phone numbers from my data. Not just on the export file but on the actual damn file.

So I'm getting to to go through a few thousand records and re do what I did a couple weeks back.
I dont' know WTF is going on and the IT guys are trying to figure it out but I've had to remove myself from the email chain before I did something to get myself fired.
Ugly people have sex all the time. We wouldn't have 6 and a half billion humans if you had to be beautiful to get laid.
paulWTAMU
Gerbil Elder
 
Posts: 5517
Joined: Wed Nov 24, 2004 5:14 am
Location: Amarillo, Texas

Re: database migration can suck it

Postposted on Thu Apr 26, 2012 11:22 am

Restore your work from backups. Problem solved! :)

Sounds awful....
"I take sibling rivalry to the whole next level, if it doesn't require minor sugery or atleast a trip to the ER, you don't love her." - pete_roth
"Yeah, I see why you'd want a good gas whacker then." - VRock
dextrous
Gerbil Elite
 
Posts: 562
Joined: Mon Nov 22, 2004 1:49 pm
Location: Ooooooooooklahoma

Re: database migration can suck it

Postposted on Thu Apr 26, 2012 11:32 am

yeah, I wish. We can't do our own back up, and the exports ARE our backups. The do a full export, clean it up and simplify it for the public site and store a digital copy of the full export in a couple locations.
Ugly people have sex all the time. We wouldn't have 6 and a half billion humans if you had to be beautiful to get laid.
paulWTAMU
Gerbil Elder
 
Posts: 5517
Joined: Wed Nov 24, 2004 5:14 am
Location: Amarillo, Texas

Re: database migration can suck it

Postposted on Thu Apr 26, 2012 12:05 pm

sounds like there is a bigger problem of access for morons to screw things up as well as lack of backups.
You don't have to feel safe to feel unafraid.
danny e.
Maximum Gerbil
Gold subscriber
 
 
Posts: 4367
Joined: Thu Apr 25, 2002 3:09 pm
Location: Indonesia/Nebraska/Wisconsin

Re: database migration can suck it

Postposted on Thu Apr 26, 2012 12:37 pm

Man, I got a daily MSSQL dump script that runs plus transaction logs. It was pretty simple to set up in the SQL Management Studio. Do you use something similar? Or is this some crazy other db that no one knows how to maintain? I'm no db admin at all and I was able to figure 'er out.
Scrotos
Graphmaster Gerbil
 
Posts: 1028
Joined: Tue Oct 02, 2007 12:57 pm
Location: Denver, CO.

Re: database migration can suck it

Postposted on Thu Apr 26, 2012 12:53 pm

paulWTAMU wrote:yeah, I wish. We can't do our own back up, and the exports ARE our backups. The do a full export, clean it up and simplify it for the public site and store a digital copy of the full export in a couple locations.


Well, the above is a serious problem if this data is at all meaningful to your business. Backups are critical, in part to prevent exactly the sort of issue that you're dealing with right now. An export is not a backup; there are too many things that can go wrong as a part of an export.

What kind of a database are we talking about here, anyway? You mention in your OP that they somehow lost data in the exports and in the database itself?? That sounds awfully fishy to me.
cphite
Gerbil Elite
 
Posts: 543
Joined: Thu Apr 29, 2010 9:28 am

Re: database migration can suck it

Postposted on Thu Apr 26, 2012 1:05 pm

someone forgot to type commit;

What type of databases are you dealing with? Though I guess it'd just be one now.
I may be able to offer some advice / tips - if not to recovering your data, at least to do a local backup 'just in case'
[I know this isn't an effective backup practice, it just guards against when someone hits the wrong switch and wipes out the db]
My Dreamcast PC thread
Main Rig: FX-6100 / Radeon 6950 / Velociraptor HD because old school rotations
pikaporeon
Graphmaster Gerbil
 
Posts: 1312
Joined: Mon Nov 19, 2007 4:42 pm
Location: Mississauga, ON, Canada.

Re: database migration can suck it

Postposted on Thu Apr 26, 2012 3:16 pm

pikaporeon wrote:someone forgot to type commit;

What type of databases are you dealing with? Though I guess it'd just be one now.
I may be able to offer some advice / tips - if not to recovering your data, at least to do a local backup 'just in case'
[I know this isn't an effective backup practice, it just guards against when someone hits the wrong switch and wipes out the db]


I second everything Pika says above. What DBMS?
BIF
Gerbil Jedi
Gold subscriber
 
 
Posts: 1543
Joined: Tue May 25, 2004 7:41 pm

Re: database migration can suck it

Postposted on Thu Apr 26, 2012 3:47 pm


Well, the above is a serious problem if this data is at all meaningful to your business. Backups are critical, in part to prevent exactly the sort of issue that you're dealing with right now. An export is not a backup; there are too many things that can go wrong as a part of an export.

What kind of a database are we talking about here, anyway? You mention in your OP that they somehow lost data in the exports and in the database itself?? That sounds awfully fishy to me.


You're telling me. All I know for sure is I can't do a back up restore from thiers because that's how it is in thier backup right now.

It's VisionLink OS. I don't know if it's technically actually a database because it's software for information and referral. But my part of it is maintaining a listing of agencies, and what programs and services they provide. IIRC it's done in XML but I could be wrong; honestly once it gets technical I get lost pretty quick.

We've had problems before with the data provider field (denotes what location provided the data) changing back and forth randomly too, and they're thinking it could be tied into a similar issue; I don't know how they resolved it that time but it has been stopped. IF that's the case it could have happened a few days to a couple weeks ago, and only been caught during the quality check when they tried to export--I don't go in and review records daily (although it isn't a bad idea, I may need to start doing that).
I'm hoping :X If I have to do this next month I'm going to scream.
Ugly people have sex all the time. We wouldn't have 6 and a half billion humans if you had to be beautiful to get laid.
paulWTAMU
Gerbil Elder
 
Posts: 5517
Joined: Wed Nov 24, 2004 5:14 am
Location: Amarillo, Texas

Re: database migration can suck it

Postposted on Fri Apr 27, 2012 11:00 am

Resolution! They apparently somehow reverted my location and one or two tohers to an older version of the data by accident.
I dont' know if i should be happy it's fixed or paranoid as hell that they managed to do that.
Ugly people have sex all the time. We wouldn't have 6 and a half billion humans if you had to be beautiful to get laid.
paulWTAMU
Gerbil Elder
 
Posts: 5517
Joined: Wed Nov 24, 2004 5:14 am
Location: Amarillo, Texas

Re: database migration can suck it

Postposted on Fri Apr 27, 2012 11:54 am

I will admit ignorance about Visionlink OS except for what I saw on their homepage.

It's a community OS, whatever that means. Doesn't seem to be an actual database, although a database could be whatever you call it...for example, I might call my spreadsheets "databases" (but that doesn't make them so, haha! :lol: ).

I suspect that Visionlink is either lacking in recovery capabilities when compared to a bonafide database such as SQL Server, Sybase, Oracle, DB2, or even "My SQL", or else the support staff may be lacking in recovery knowledge... :roll:
BIF
Gerbil Jedi
Gold subscriber
 
 
Posts: 1543
Joined: Tue May 25, 2004 7:41 pm

Re: database migration can suck it

Postposted on Mon Apr 30, 2012 8:23 am

BIF wrote:I will admit ignorance about Visionlink OS except for what I saw on their homepage.

It's a community OS, whatever that means. Doesn't seem to be an actual database, although a database could be whatever you call it...for example, I might call my spreadsheets "databases" (but that doesn't make them so, haha! :lol: ).

I suspect that Visionlink is either lacking in recovery capabilities when compared to a bonafide database such as SQL Server, Sybase, Oracle, DB2, or even "My SQL", or else the support staff may be lacking in recovery knowledge... :roll:

Hey no need to derisively separate MySQL... except that I don't trust Oracle to not run it into the ground (and prefer Postgres).
My Dreamcast PC thread
Main Rig: FX-6100 / Radeon 6950 / Velociraptor HD because old school rotations
pikaporeon
Graphmaster Gerbil
 
Posts: 1312
Joined: Mon Nov 19, 2007 4:42 pm
Location: Mississauga, ON, Canada.


Return to The Back Porch

Who is online

Users browsing this forum: just brew it! and 10 guests