BackupPC-users

Re: [BackupPC-users] mysql streaming

2013-04-25 19:11:12
Subject: Re: [BackupPC-users] mysql streaming
From: Lord Sporkton <lordsporkton AT gmail DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 25 Apr 2013 16:09:43 -0700
I'm aware of zmanda and several other backup options however at this time this is what we have and this is what we are trying to leverage. Perhaps it will turn out that writing to a flat file is the only option. But the nature of the backuppc commands leads me to believe there is some possibility to link streams. mysqldump streams into a file and backuppc "appears" to stream from the local file, across the tunnel. This leads me to believe(and i could of course be wrong due to some caveat that Im simply not aware of yet) that If i could redirect backuppc to stream from a stream rather than file, i could get it to work. Tar is of course capable of accepting either stream or file as input and mysqldump is capable of outputing to either stream or file. I suppose I will just have to play around with it more maybe. 




On 25 April 2013 15:44, Mark Rosedale <mrosedale AT vivox DOT com> wrote:
>From the sound of things backuppc probably isn't the best bet for you. It works on the file level, which won't work for mysql. This leaves you with really one option for backing up db's and that is writing to a flat file. What you may need is some sort of block level backup, this way you can backup directly from the db without running a dump. I think zmanda might do what you are looking for.

----- Original Message -----
From: "Lord Sporkton" <lordsporkton AT gmail DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Sent: Thursday, April 25, 2013 6:35:20 PM
Subject: Re: [BackupPC-users] mysql streaming



It is on linux yes. That is not out of the question, but it would be preferred for management purposes to do it though the command in backuppc. Its not just one server, its dozens and growing. Its also multiple customers and departments.



On 25 April 2013 14:53, Sabuj Pattanayek < sabujp AT gmail DOT com > wrote:


Does your mysql db live on a unix system? If so, why not use
automysqlbackup and just have it dump to your backup system over NFS?



On Thu, Apr 25, 2013 at 4:45 PM, Lord Sporkton < lordsporkton AT gmail DOT com > wrote:
> I'm currently backing up mysql by way of dumping the DB to a flat file then
> backing up the flat file. Which works well in most cases except when someone
> has a database that is bigger than 50% of the hdd. Or really bigger than
> around say 35% of the hdd if you account for system files and a reasonable
> amount of free space.
>
> I started thinking, mysqldump streams data into a file and then backuppc
> streams that file for backup. So why not cut out the middle man file and
> just stream right into backuppc? Ive been playing with the backup commands
> but im getting some unexpected results due to what I believe is my lack of
> total understanding of how backuppc actually streams things.
>
> So my overall question is. Does anyone have any clues or hints or ideas on a
> way to modify the backup command such that it calls either mysqldump or a
> script that would generate a file stream at backup time into the backuppc
> tunnel?
>
> So far using the tar backup method seems to be the best idea, I tried
> modifying the tar command but that seemed to screw with the backuppc server
> side. so it looks like im gonig to have to just add something to the tar
> command so it streams the file into the backuppc tar command(as opposed to
> replacing the tar command).
>
> Lawrence
>
>
> ------------------------------------------------------------------------------
> Try New Relic Now & We'll Send You this Cool Shirt
> New Relic is the only SaaS-based application performance monitoring service
> that delivers powerful full stack analytics. Optimize and monitor your
> browser, app, & servers with just a few lines of code. Try New Relic
> and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki: http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>

------------------------------------------------------------------------------
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


------------------------------------------------------------------------------
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/