[00:30] <qman__> no
[00:31] <qman__> even though the disks in a mirror contain the same user data, they are not the same disk
[00:31] <qman__> the metadata will be wrong and it will rebuild anyway
[00:31] <vlad_starkov> Nice article about choosing hard drive http://www.directron.com/howtochoosha.html
[00:32] <vlad_starkov> qman__: oh I see, thanks!
[00:33] <vlad_starkov> So what is more reliable: SSD or HDD?
[00:35] <qman__> neither is particularly reliable
[00:35] <qman__> if you care about your data, implement a good backup system
[00:36] <qman__> and, the old addage is true: raid is not backup
[00:37] <qman__> raid is there to possibly prevent you from needing your backup, but it doesn't replace it
[00:37] <vlad_starkov> Question: what is the best strategy to scheduled replace all old hard drives for multiple servers with RAID1? For the moment, I think we need 2 planned maintenances: first – remove 1 of 2 existing drives and add new drive so md will recover data on the new drive; second – removing second old drive and add new one instead, so md will recover data on it from the previous new drive. So that system will have 2 completely new
[00:37] <vlad_starkov> drives.
[00:38] <qman__> that's a good strategy
[00:38] <vlad_starkov> qman__: OK
[00:38] <butchlugrod> back up early, back up often, back up off site.
[00:38] <qman__> it has the benefit of that first-removed drive being a backup copy
[00:38] <qman__> if your hardware supports it, there is a third option
[00:39] <qman__> add your disks to the existing mirror without removing the old ones
[00:39] <qman__> then remove the old ones after the resync
[00:39] <vlad_starkov> But I'm wondering when md starts recovering process, may I use the server? Or it is better to unplug it from network and let md finish recovering?
[00:40] <vlad_starkov> qman__: you mean 3 drive slots on a single system?
[00:40] <qman__> the recovery process happens in the background and does not require downtime; that said, if your system is on the raggedy edge in terms of performance, you may slow down beyond the point of workability
[00:40] <qman__> actually I mean 4, but yes
[00:41] <vlad_starkov> qman__: for these servers we have only to slots and they're not removable
[00:41] <qman__> in a raid 1 you can add as many mirrors as you want
[00:41] <vlad_starkov> qman__: really?
[00:41] <qman__> so adding 3 or 4 mirrors, then removing the old ones, is a valid strategy too
[00:41] <vlad_starkov> I didn't know that
[00:46] <vlad_starkov> qman__: how the system know what to recover if at the beginning of recovery process the MyFile.doc was 15 pages book, and then I turned on my server in degraded raid mode so recovering could proceed in background, and then when system done recovering this MyFile.doc for 50% (theoretically) I saved new version of that file, that contains 30 pages and different content of some paragraphs in the first 3 pages. How system knows w
[00:46] <vlad_starkov> hat is the valid version of MyFile.doc for the moment?
[01:10] <qman__> vlad_starkov, it updates it on the fly
[01:11] <qman__> how exactly it does this is a bit voodoo magic to me, but it automatically handles writes while resyncing
[01:11] <vlad_starkov> qman__: OK np
[01:12] <vlad_starkov> Want to read a good book about raid and related
[01:16] <vlad_starkov> Some stat on cloning 1TB SATA2 drive: from 0 to first ~400GB the speed was ~ 86Mbyte/sec. Now it's 485GB and speed is ~77Mbyte/sec
[01:17] <patdk-lap> qman, it's very simple
[01:17] <patdk-lap> when you write, it writes
[01:17] <patdk-lap> no vodo needed
[01:17] <patdk-lap> when you read it will limit reads from the good drive, till it's done
[01:17] <qman__> that works on a raid 1, but how it does it on a raid 5 or 6 is still a bit confusing
[01:18] <patdk-lap> ya, it bitmap tracks it
[01:18] <patdk-lap> that was going be my next saying
[01:19] <patdk-lap> vlad_starkov, you know harddrives start fast, then get upto like 1/3 their speed at the end?
[01:19] <patdk-lap> if it starts at 120mb/sec, you can expect 50mb/sec at the end of the disk
[01:19] <vlad_starkov> patdk-lap: I didn't
[01:19] <patdk-lap> heh?
[01:19] <patdk-lap> you have never seen a harddrive benchmark ever in your life?
[01:20] <vlad_starkov> I noticed that but never know that it's normal behaviour
[01:20] <qman__> it's because the beginning of a hard drive is at the outside edge of the disk
[01:20] <qman__> which, by the nature of rotation, is capable of a much faster speed than the inner edge
[01:20] <patdk-lap> http://img40.imageshack.us/img40/5864/hdtuneproahcibenchmarkv.png
[01:20] <vlad_starkov> 514GB done, speed is ~74MByte/sec
[01:21] <qman__> optical discs are set up the opposite way
[01:21] <qman__> with the start on the inside, working out
[01:21] <vlad_starkov> A century study
[01:21] <patdk-lap> ever since they switched form constant sectors per track
[01:21] <vlad_starkov> What about SSD?
[01:22] <patdk-lap> ssd's don't normally rotate
[01:22] <vlad_starkov> ))
[01:22] <qman__> they're just flash chips
[01:22] <qman__> should be a flatline
[01:22] <patdk-lap> well, if it was ram it would be
[01:23] <patdk-lap> flash is on page/block issues, for writing
[01:23] <patdk-lap> for reading, it's just how many chips you have
[01:23] <vlad_starkov> So when manufacturer specify read/write timeout, speed and so on, is it an average value or what?
[01:24] <patdk-lap> depends what value your looking at
[01:24] <patdk-lap> avgerage latency, is just that avg
[01:24] <qman__> they would normally publish both
[01:24] <patdk-lap> speed, will be max
[01:25] <patdk-lap> if you notice you get basically max speed for half the disk
[01:25] <patdk-lap> so if you shortstroked the disk 50% :)
[01:25] <qman__> it's actually a common tactic
[01:25] <qman__> well, was, before SSD
[01:25] <vlad_starkov> the hdd technology now seems so old...
[01:25] <qman__> if you needed faster disks but didn't need the space, just make your partitions small at the start of the disk
[01:26] <qman__> stay within the high range of speed and reduce latency because you're only seeking over part of the disk
[01:26] <vlad_starkov> What max sizes of disks Ubuntu supports?
[01:26] <vlad_starkov> qman__: I see. Good trick
[01:27] <qman__> now you just buy SSD because it's almost an order of magnitude faster and seek times are nonexistant
[01:28] <patdk-lap> hmm, for 64bit? something like pb's per disk
[01:28] <patdk-lap> for ext4? we still at 16tb cap? for ext4tools?
[01:28] <qman__> yeah, the software is way ahead of the hardware on that one
[01:28] <qman__> nah
[01:28] <qman__> ext4 is something like 8eb
[01:28] <patdk-lap> no
[01:28] <qman__> ext3 is 16TB
[01:28] <patdk-lap> ext4 could do it, but the tools couldn't
[01:29] <patdk-lap> so it wasn't possible to format it
[01:29] <patdk-lap> atleast when 12.04 came out
[01:29] <vlad_starkov> so RAID 10 of 16TB is ok for Ubuntu 12.04?
[01:29] <qman__> yes, no problem
[01:29] <qman__> and even if you can't go bigger with ext4, there's still xfs
[01:29] <vlad_starkov> 16Tb with ext4 or ext3?
[01:29] <qman__> yes
[01:29] <patdk-lap> both
[01:29] <vlad_starkov> nice
[01:30] <patdk-lap> just the ext lib needs to be fixed up in order to format bigger, was the issue
[01:30] <patdk-lap> I haven't looked back into that isuse for awhile
[01:30] <patdk-lap> mainly cause I've gone zfs
[01:30] <qman__> should be straightforward, I'd be really surprised if it isn't fixed yet
[01:30] <vlad_starkov> don't know is it reliable to build raid 10 of 4+4 drives. Chances that more than one will fail
[01:30] <patdk-lap> I have a few 30+tb ntfs volumes
[01:31] <qman__> ouch
[01:31] <patdk-lap> well, generally, going >2tb with raid1 or raid5 is a bad idea
[01:31] <patdk-lap> qman, it works well :) just backups
[01:31] <qman__> ntfs is just plain awful in terms of performance
[01:32] <patdk-lap> really suggest only using raid6 and 3way mirrors for that size
[01:32] <qman__> I can't imagine how bad the fragmentation would be on 30TB
[01:32] <patdk-lap> qman__, I'm getting a nice 1400MB/sec
[01:32] <patdk-lap> qman__, fragmentation? on files >100gigs?
[01:32] <vlad_starkov> I want to read about it to dig deeper file systems
[01:33] <qman__> I guess it wouldn't be TOO bad if you _only_ have giant files
[01:33] <patdk-lap> I did say, backups
[01:33] <qman__> but windows just does absolutely retarded things on write
[01:33] <qman__> brand new system install is something like 15% fragmented
[01:33] <qman__> literally copy and paste from CD
[01:34] <patdk-lap> well, copy/paste is a good method really
[01:34] <patdk-lap> but in order to get that fragmented something else is going on
[01:34] <qman__> yeah, the ntfs driver
[01:35] <patdk-lap> it's better than the alternatives :)
[01:35] <patdk-lap> fat12?
[01:35] <vlad_starkov> Do you guys know who is the best on SSD market today?
[01:35] <patdk-lap> !best
[01:36] <vlad_starkov> !best on the ssd market
[01:36] <vlad_starkov> )
[01:37] <vlad_starkov> 586GB done, speed is 72Mbyte/sec
[01:37] <vlad_starkov> Don't know is it normal result for 1TB drive?
[01:37] <patdk-lap> 100mb/sec max speed
[01:37] <patdk-lap> so 40mb/sec slow
[01:38] <vlad_starkov> ok
[01:38] <patdk-lap> your just over halfway
[01:38] <patdk-lap> so you will see speed drop off good
[01:38] <patdk-lap> but is that for hte whole array? or per disk?
[01:39] <vlad_starkov> so while cloning there is 0 errors. Does it mean that disk does not contain BADs or BADs could be detected on write operation?
[01:39] <vlad_starkov> I clone single 1Tb SATA2 drive to another exactly the same
[01:40] <patdk-lap> well, that only means it didn't get a read error from the disk
[01:40] <vlad_starkov> using GNU ddrescue
[01:40] <patdk-lap> it doesn't mean the data it got from the disk was correct :)
[01:40] <vlad_starkov> so errors classified to read and write?
[01:40] <vlad_starkov> oh
[01:40] <patdk-lap> disks are only suppost to return bad data 1 out of 10^14 times
[01:41] <vlad_starkov> almost never
[01:41] <patdk-lap> na, that would be enterprise disks, 1 out of 10^15 times
[01:41] <patdk-lap> I have several bad data reads from disks
[01:41] <qman__> with the size of modern disks, silent corruption is a real issue
[01:42] <vlad_starkov> ok you convinced me: backups, backups, backups...
[01:42] <qman__> if your data is important you need to verify it with good checksums
[01:43] <vlad_starkov> qman__: I always wanted to ask, how checksum works?
[01:43] <qman__> I wanted to go with zfs for the data integrity but it kept locking up my server
[01:44] <qman__> a checksum, in its most basic form, adds up all the bits of a given set of data and returns the total
[01:45] <qman__> in simple, small scale stuff like ECC, it just records whether a byte has an even or odd number of ones
[01:45] <qman__> with more complex stuff like md5 or sha1, it performs a hashing algorithm on the data
[01:45] <qman__> if any bits get flipped, the checksums won't add up the same
[01:46] <vlad_starkov> that's interesting. A few days ago I learned how does SSL/TLS actually work
[01:47] <qman__> in the case of large files and algorithms like md5 or sha1, collisions can and do happen, so you have to take more than just that string into consideration
[01:48] <vlad_starkov> qman__: many times I downloaded files from Internet there was additional .md5 or .sha1 files with the same basename. How should I use these files to validate checksum on Ubuntu?
[01:48] <qman__> while it's reasonably possible that any two given files could have the same checksum (and even likely in some cases), it's astronomically unlikely that two files of identical size with different data will match
[01:48] <qman__> especially in the case of a handful of bit flips
[01:48] <qman__> md5sum filename
[01:49] <vlad_starkov> and then compare it with content of .md5 file? in case of sha1 what will be command?
[01:51] <qman__> sha1sum
[01:52] <qman__> you can also verify a burned disc that way, md5sum /dev/cdrom
[01:52] <qman__> or whatever your disc drive is
[01:53] <qman__> a properly burned iso will match exactly on-disc
[01:54] <vlad_starkov> nice
[01:54] <vlad_starkov> how do you know all these? how long do you use Linux?
[01:54] <qman__> I first started taking it seriously around 2004
[01:57] <qman__> my formal education is windows focused, but linux is my preferred operating system
[01:57] <qman__> I also have some experience with solaris and freebsd
[01:58] <vlad_starkov> qman__: I just started learn it seriously a three months ago. Reading book and all new. Runlevels was pretty complicated but I deal with them.
[01:59] <vlad_starkov> The thing I still do not understand is mail system.
[01:59] <qman__> runlevels don't really exist in ubuntu, upstart works differently
[01:59] <vlad_starkov> Yep, I read it in the book)
[01:59] <qman__> it still deals with them in order to support sysv-style software
[02:01] <vlad_starkov> it's a bit harder when you learn something that has a history. Linux is such a thing. I think it should be much faster to learn new things when you have some experience.
[02:02] <qman__> very much so
[02:02] <vlad_starkov> qman__: you're right
[02:02] <qman__> once you reach a certain level of knowledge, you can work toward pretty much any problem you encounter
[02:02] <vlad_starkov> yepp
[02:02] <qman__> you need a basic level of experience and knowledge of tools to work through problems
[02:03] <qman__> coupled with good google skills, you can solve nearly anything
[02:05] <vlad_starkov> I think you have to know a set of technologies. There's just a set of them that is a part of almost every product today. After you deal with them then you just have to keep up to date your knowledge.
[02:08] <vlad_starkov> qman__: about SMART, is it really objective and helpful?
[02:09] <qman__> yes
[02:09] <qman__> it's not perfect, and you shouldn't expect disks to always warn you before they fail
[02:09] <qman__> but around 9 out of 10 times, disks will show errors in the SMART log before they go
[02:09] <qman__> giving you a nice heads-up
[02:10] <vlad_starkov> how much time do I have after first disk error notification?
[02:10] <qman__> could be a month, could be an hour
[02:11] <qman__> the good news is, any errors in the SMART log normally qualify for RMA status
[02:11] <qman__> except for temperature ones
[02:11] <vlad_starkov> what is RMA?
[02:11] <qman__> return to the manufacturer for replacement
[02:12] <vlad_starkov> 730GB done; 64MByte/sec
[02:12] <vlad_starkov> oh nice
[02:13] <vlad_starkov> I heard WD gives 5 years warranty
[02:13] <qman__> only on some drives
[02:13] <vlad_starkov> 2 years at least
[02:13] <qman__> only on some drives
[02:13] <qman__> both manufacturers offer anywhere from 1 to 5 year warranties depending on the class of drive you purchase
[02:13] <vlad_starkov> As I know many manufacturers gives at least 2 years
[02:14] <vlad_starkov> server drives
[02:14] <qman__> there are only two hard drive manufacturers, seagate and western digital
[02:14] <qman__> they own all the other brands
[02:14] <qman__> seagate bought samsung's hard drive division, and western digital bought hitachi
[02:15] <qman__> there are only two hard drive manufacturers, seagate and western digital
[02:15] <qman__> they own all the other brands
[02:15] <qman__> seagate bought samsung's hard drive division, and western digital bought hitachi
[02:16] <qman__> and I'm pretty sure fujitsu stepped out of hard drive manufacturing
[02:17] <vlad_starkov> which one do you prefer?
[02:17] <vlad_starkov> WD or Seagate?
[02:17] <vlad_starkov> My faulty drive is Hitachi
[02:19] <qman__> I don't really have much of a preference, I've lost the most seagates but I've also bought the most seagates
[02:19] <qman__> my last purchase was WD reds, trying those out
[02:21] <vlad_starkov> What's the difference between WD series?
[02:21] <qman__> the warranty, mostly
[02:21] <qman__> that, and blues and greens will probably not work with a hardware raid controller
[02:22] <qman__> because they're designed specifically to not be
[02:22] <qman__> I also recommend against any and all green drives
[02:22] <qman__> they're by and large crap
[02:23] <qman__> greens are intended for low-use patterns, such as external hard drives or a web-browsing desktop
[02:23] <qman__> blues are intended for typical desktops, reds for NASes, blacks for high performance desktops, and then they have raid class drives for servers
[02:25] <qman__> the raid class drives are a lot more expensive so I'm trying the reds, since that's pretty similar to the role my server plays
[02:26] <qman__> my personal experience has been about 20% failure rate within the warranty period across all drives and manufacturers that I've purchased
[02:31] <vlad_starkov> Ok that's valuable for me
[02:31] <vlad_starkov> qman__: thanks for advices
[04:17] <vlad_starkov> qman__: Success! I recovered my RAID1
[09:08] <hXm> hello
[09:09] <hXm> i have a dedicated server with a company, i wonder how can i manage the backups
[09:09] <hXm> i could like use something like dropbox or google drive
[09:09] <hXm> is that possible?
[09:53] <jacobw> hXm: Hosting providers often offer some kind of backup service
[09:56] <hXm> yes
[09:56] <hXm> but in my case they only do it with a professional plan
[09:58] <jacobw> Backup isn't a simple service
[09:58] <hXm> i know
[09:59] <hXm> but dropbox could be a temporary solution
[10:01] <jacobw> http://lassebunk.dk/2011/03/16/linux-dropbox-remote-backup/
[10:02] <jacobw> AFAIK, there's no offical Linux client for Google Drive
[10:02] <hXm> gdrive gives 7gb, i thought it gave more
[10:02] <hXm> i prefer dropbox since i have the free 20gb
[10:03] <hXm> i installed dropbox with something like that, now i just want to know how to sync different folders
[10:03] <mardraum> didn't google recently combine mail and gdrive amounts?
[10:04] <mardraum> regardless if they did or didn't, your "backup solution" still sucks :P
[10:04] <hXm> haha i know :)
[10:04] <hXm> i just dont want to lose something before than i decide if switch to pro or not
[10:05] <hXm> Estás utilizando 6 MB de 5 GB (0 MB en la Papelera).
[10:05] <hXm> still 5gb even
[10:05] <hXm> google drive sucks more than my backup
[10:06] <mardraum> why not just use rsync to home?
[10:06] <hXm> my home to where, an external hd?
[10:06] <mardraum> I don't know about your home
[10:06] <hXm> is a remote dedicated server
[10:06] <mardraum> that's nice
[10:07] <mardraum> why not rsync your settings from your remote dedicated server to home?
[10:07] <hXm> that means incremental backups in cron, isnt?
[10:08] <hXm> subversion service are so cool, they doesnt lose a line of typed code
[10:10] <mardraum> yes, you can run rsync from cron, I don't understand your question
[10:10] <mardraum> if you don;t know what rsync is, you really should go and learn
[10:10] <hXm> what i mean is, rsync requires a cron, then is not real-time backup
[10:11] <hXm> did i explain it right now?
[10:15] <hXm> dont be rude, i have neuronal deficit because im spanish
[10:43] <jacobw> hXm: What are you backing up?
[10:46] <hXm> jacobw: sites, sql databases and few tcl scripts
[10:51] <jacobw> For the code, you should consider developing with git on your workstation and pushing to your server, or pushing to a repository on your server and cloning the repository to your working directories
[10:51] <jacobw> Are you dumping the MySQL databases to SQL files with cron?
[10:53] <hXm> i use transact-sql
[10:53] <hXm> yep, with cron
[10:54] <hXm> about the git i tried configure it twice, then i gave up (in this case i also still live with the dropbox crap-solution)
[10:54] <hXm> i know git is easy to configure and use but for some reason it wont work for
[10:54] <hXm> i didnt paid much attention so probably thats the fault
[10:54] <hXm> i hope the day had 32 hours instead
[10:59] <Senor> how can I communicate with memcache server ?
[11:15] <jacobw> hXm: What problem did you have with Git? It's a bit counter intuitive the first time but there's a lot Git users here and in #git
[11:17] <jacobw> hXm: Check out gitref.org and https://www.youtube.com/watch?v=ZDR433b0HJY
[11:37] <hXm> jacobw: im watching it right now
[11:37] <hXm> do you know if google apps support git hosting?
[11:39] <jacobw> hXm: A git repository is just a directory, so you can put it anywhere that supports file storage, but I don't think any Google Apps integrate with Git right now
[12:48] <bitbyte> hey guys can you help me find a way to get apt-get working agian
[12:48] <bitbyte> keep getting issues with E: Problem with MergeList /var/lib/apt/lists/security.ubuntu.com_ubuntu_dists_quantal-security_main_i18n_Translation-en
[12:53] <andol> bitbyte: try apt-get --list-cleanup update
[12:53] <bitbyte> ill give that a shot now
[12:55] <andol> bitbyte: Otherwise you can try manually deleting the problematic file. Those files in that directory (/var/lib/apt/lists) will be recreated upon apt-get update
[12:56] <bitbyte> andol: i get bitbyte@bitbyte-core:~$ sudo apt-get -list -cleanup update
[12:56] <bitbyte> E: Command line option ‘l’ [from -list] is not known.
[12:56] <andol> bitbyte: That wasn't the option I gave you :P
[12:56] <andol> apt-get --list-cleanup update
[12:57] <bitbyte> haha sorry my eye sights bad,
[12:57] <bitbyte> but just removed the file and went through
[12:58] <bitbyte> removing the file seemed to work
[12:59] <bitbyte> mmmmmm any reason why the package list would fall over ?
[13:27] <andol> bitbyte: Well, could have been some hickup on the repo server, and hat you managed to try to download the old version of that file at the very wrong moment, or perhaps that cron was making an apt-get update in the background while you rebooted the machine, or perhaps your local disk going bad, or something else.
[13:27] <bitbyte> mmmm
[13:27] <bitbyte> well thanks for getting back to me
[13:27] <bitbyte> I'm following this guide
[13:27] <bitbyte> http://www.thefanclub.co.za/how-to/how-setup-ubuntu-business-box-server-ubb-part-1
[13:28] <bitbyte> to setup my server for a test
[13:28] <andol> bitbyte: Unless that same thing happen again, I wouldn't worry about it.
[13:30] <bitbyte> andol: thanks for taking a look :)
[13:50] <ruben231> hi guys i have a ubuntu server with 250GB HDD only setup to entired disk used with LVM and i have added a new HDD 2 terbytes, how do i configure this and add it to the curent storage somehow..?
[13:52] <patdk-lap> add it?
[13:52] <patdk-lap> you mean you want to do like a raid0? where if one disk fails it all fails?
[13:52] <patdk-lap> pvcreate, vgadd, lvextend
[13:53] <ruben231>  patdk-lap: just wanted to increase the existing HDD storage..how
[13:55] <ruben231> patdk-lap: this is my output after i conencetd the additonal HDD --> http://pastebin.com/mxHgdK55
[13:57] <ruben231> guys any help
[14:13] <bugzc> hey, anyone with experience in bonding nics? I'm having some issues where im guessing one of the interfaces isnt coming up in time and im getting a message saying something along the lines of 'waiting up to 60 more seconds for network'. after the message it boots into the server fine. no mac address associated w/ bond0. im using mode0 bond and 3 nics teamed up. ubuntu 12.04.2LTS. more or less a clean install.
[14:15] <RoyK> bugzc: have been (and still are) using bonding, yes
[14:15] <RoyK> bugzc: what is mode0?
[14:17] <RoyK> balance-rr it seems
[14:17]  * RoyK likes the text-based names better
[14:18] <RoyK> bugzc: I haven't used balance-rr, though. Currently using active-backup, and have used LACP earlier
[14:20] <patdk-lap> how is it connected?
[14:20] <patdk-lap> hopefully not to a switch
[14:22] <bugzc> all ethernet cards are connected to a cisco unmanaged switch
[14:22] <patdk-lap> hmm, balance-rr doesn't work that way
[14:22] <patdk-lap> no wonder
[14:22] <RoyK> bugzc: get a managed switch and use LACP
[14:23] <bugzc> What Im trying to achieve is network aggregation so bandwidth is provided/shared by all nics
[14:23] <RoyK> yes, that works rather well with LACP
[14:23] <bugzc> Cant replace the switch here. Gotta work with what ive got, unfortunately
[14:23] <patdk-lap> heh? just use tlb mode
[14:23] <patdk-lap> or alb, but alb causes issues with lots of things
[14:23] <patdk-lap> if you need reliable incoming balancing, lacp is best
[14:23] <patdk-lap> outgoing only, tlb works good
[14:24] <bugzc> it's basically a caching proxy
[14:24] <patdk-lap> and that means to me? nothing?
[14:24] <RoyK> well, it should be mostly outgoing, then
[14:24] <bugzc> well it needs to provide a lot of bandwidth, thats what I mean. But not much for incoming
[14:24] <RoyK> try tlb
[14:25] <RoyK> but
[14:25] <RoyK> if you need >1Gbps for a caching proxy, why on earth don't you have a managed switch?
[14:25] <bugzc> because there is no budget and im improvising :)
[14:26] <RoyK> http://www.ebay.com/itm/CISCO-WS-C2950T-24-CATALYST-SWITCH-10-100B-TX-1000Base-T-GIGABIT-UPLINKS-MANAGED-/290839605531?pt=US_Network_Switches&hash=item43b764311b
[14:26] <RoyK> well, not gigabit, though
[14:26] <RoyK> but you can get them quite cheap
[14:27] <RoyK> and managed switches save you a *lot* of headache
[14:28] <bugzc> aye but the company wont let me expense anything any time soon, alas. So my priority right now is to improvise and get bonding to work. I have it working quite nicely on my windows server with Intel nics.
[14:28] <RoyK> what sort of bonding do you use on windoze_
[14:28] <RoyK> ?
[14:29] <patdk-lap> well, windows only supports failback and lacp I think
[14:29] <bugzc> the intel nic driver supports aggregation+fallback
[14:29] <bugzc> yes but Intel has a proprietary driver for that
[14:29] <patdk-lap> so does hp
[14:29] <bugzc> so im getting a 2gbps link shared for samba etc
[14:29] <patdk-lap> the hp one does lots of options
[14:29] <patdk-lap> heh?
[14:30] <patdk-lap> it's doing lacp without confirming it with the switch
[14:30] <patdk-lap> so it's basically doing tlb
[14:30] <bugzc> nice
[14:30] <bugzc> seems so
[14:30] <bugzc> Alright let me set it up as tlb and see what I get here
[14:31] <RoyK> bugzc: but really, tell your boss you need a managed switch
[14:31] <bugzc> I have many times lol
[14:31] <patdk-lap> a managed 10gbit 24port switch
[14:31] <RoyK> do you have an internet link > 1Gbps and no managed switches?
[14:31] <RoyK> patdk-lap: we have a few ;)
[14:32] <RoyK> patdk-lap: 10Gbps internet access from work...
[14:32] <patdk-lap> royk, I'm close to getting one (for home)
[14:32]  * RoyK wonders who might need 10Gbps at home
[14:32] <patdk-lap> I  could use 100gbit, but that is kind of pricy
[14:33] <RoyK> patdk-lap: infiniband?
[14:33] <patdk-lap> ya, I have infiniband
[14:33] <RoyK> ok
[14:33] <patdk-lap> but attempting to drop it
[14:33] <RoyK> trying to cut down? ;)
[14:33] <patdk-lap> just not worth the pain of keeping it working, and playing with it's compatability issues
[14:33] <bugzc> Aye :/
[14:49] <bugzc> I wonder why all the samples/docs use mode balance-rr
[14:53] <KennettAZ> I'm trying to follow this page http://manpages.ubuntu.com/manpages/raring/man4/sge.4freebsd.html  but I've never compiled a driver.
[14:55] <bugzc> Looks like switching to tlb did not resolve the problem
[14:55] <RoyK> well, then, LACP!
[14:56] <RoyK> bugzc: if you have 10G connectivity to the net, you're bound to have a managed switch
[14:56] <bugzc> it's 1gbps
[14:56] <RoyK> then why do you need >1gpbs to the proxy?
[14:56] <bugzc> the proxy is running a raid stripe with a large cache of commonly accessed objects
[14:57] <bugzc> so clients download them through the transparent proxy instead of WAN
[14:57] <RoyK> yes, but the bottleneck isn't the network connection to the server if the internet connection is 1Gbps
[14:57] <bugzc> no no the WAN is not 1gbps lol
[14:57] <RoyK> was this a forward proxy or reverse proxy?
[14:58] <RoyK> bugzc: do you monitor the network use on this proxy?
[14:58] <bugzc> it's squid3 with caching enabled and http traffic redirected through it
[14:59] <RoyK> usually networking isn't a bottleneck for squid - often memory or I/O
[15:00] <bugzc> Aye. but I want at least a 2gb link for the large files. This serves a dual purpose as I am setting up something similar for a different use case elsewhere. Here it's not as critical
[15:02] <RoyK> just get a managed switch, then
[15:02] <RoyK> LACP is well tested
[15:02] <RoyK> well proven
[15:02] <RoyK> it works
[15:02] <bugzc> that's not really a solution as it's not an option for me
[15:03] <bugzc> I would gladly get one if the guys higher up gave me the budget to do so
[15:03] <RoyK> well, tell them there's no other options
[15:03] <RoyK> you have indeed tried
[15:04] <bugzc> Well, how come it works just fine with the intel software? I have also seen it done on centos with a similar configuration
[15:05] <mardraum> seen exactly what done?
[15:05] <bugzc> I did stumble onto this bug specific to 12.04: https://bugs.launchpad.net/ubuntu/+source/upstart/+bug/839595
[15:05] <RoyK> I somewhat wonder why someone couldn't afford a managed switch to make a proper setup when you need >1Gbps
[15:06] <bugzc> RoyK: Overe here it's more of a want than a need. It will save me time. That's why it's not high priority for the higher ups :)
[15:06] <RoyK> what sort of company is this?
[15:07] <bugzc> it's a computer service place, nothing fancy
[15:09] <RoyK> well, it's rather bad if they want you to create a good solution and can't even get a managed switch for something like $500
[15:10] <KennettAZ> I could use some help compiling a kernel
[15:10] <RoyK> !ask | KennettAZ
[15:10] <bugzc> RoyK: agreed, but again, not in my control heh
[15:10] <RoyK> heh
[15:11] <RoyK> bugzc: but what makes you think 2x1Gbps will make things go faster? Usually bandwidth to a squid proxy isn't the bottleneck
[15:12] <KennettAZ> I'm  new to linux and I need help with this.  http://manpages.ubuntu.com/manpages/raring/man4/sge.4freebsd.html
[15:12] <bugzc> So right now after waiting for the 60 sec thing it boots up and im getting no mac addr but im getting an IP i can ping. if i bring down eth0(not part of team) and try to ping the router it fails.
[15:13] <bugzc> RoyK: Well imagine 15 clients needing to download windows updates at the same time.
[15:13] <RoyK> bugzc: 1Gbps is still rather a lot
[15:13] <bugzc> time is money :)
[15:13] <RoyK> bugzc: if time is money, get a proper switch
[15:14] <RoyK> bugzc: as in *really* - you'll spend hours/days to work out something that may work, or may not, and the time you spent (time is money) could be used on a proper switch instead
[15:15] <RoyK> we considered replacing VMware with KVM, because KVM is so much cheaper, but decided managing KVM was much more time consuming than VMware, and we still run VMware
[15:15] <RoyK> same thing
[15:17] <bekks> And there is no professional support for KVM in case of need.
[15:18] <RoyK> from redhat there is
[15:18] <RoyK> but then, kvm from redhat is about as expensive as vmware
[15:18] <RoyK> and there are consultants around that can help
[15:19] <RoyK> but still, paying for good software or hardware pays in the long run
[15:19] <bugzc> Well the problem is that this is a pet project of mine. it serves a dual purpose since there is something similar I want to set up elsewhere. So the company isnt spending much if anything on my time per se
[15:19] <bugzc> i understand what you're saying but it's just not happening in my case alas
[15:19] <RoyK> then get a managed switch second hand from ebay or something
[15:19] <bekks> RoyK: You're better off using vmware then. :)
[15:20] <bugzc> RoyK: That would mean paying out of pocket
[15:20] <RoyK> you get them rather cheap, and you learn a bit more :)
[15:20] <RoyK> bugzc: if it's a private project, sure, but not sure what you mean
[15:21] <bugzc> Even $100 would be a bit of a stretch for me right now
[15:21] <bekks> If its a private project, which isnt used for business purposes, you could use vbox, too.
[15:22] <bugzc> it's a pet project that the business approved as long as I dont spend a lot of money on it and it proves fruitful. The whole proxy thing is, not the teaming bit. The teaming was an idea for a bit more optimisation.
[15:25] <RoyK> bugzc: monitor network traffic first
[15:25] <RoyK> bugzc: I really doubt you need more than 1Gbps for a proxy
[15:25] <RoyK> bugzc: install munin or something to see the actual traffic levels
[15:29] <bugzc> RoyK: traffic isnt a huge issue right now, though there are peak times, but this box will also be running PXE deployment very soon at which point it will become more of a problem
[15:32] <bugzc> RoyK: So instead of using one nic for PXE and one nic for squid, the idea was to aggregate and balance etc
[15:35] <RoyK> bugzc: I see, but I still would recommend using something standardised like LACP. Saves you a headache or three
[15:38] <bugzc> RoyK: I appreciate that and when I have the budget a managed switch will be my first investment. But how would you explain this: I did the same thing on a ESXI5.1 VM with 4 nics, 3 of them teamed in LACP, and it was doing the same thing. ESXI virtual switch supports LACP natively
[15:55] <bugzc> Any other ideas? :)
[15:59] <bitbyte> any ideas of how to add noip2 into cron so it will update on its own
[15:59] <bitbyte> I've followed all the guides and it just seems to never update
[15:59] <RoyK> bugzc: really, I don't understand why you don't get a proper switch. non-managed stuff isn't meant for production
[16:01] <bugzc> RoyK: that's one issue. But now Im talking about a setup /with/ a managed switch - and it was the same exact outcome
[16:05] <RoyK> bugzc: if you have a managed switch, enable LACP on those ports
[16:06] <RoyK> LACP needs to be configured at both ends
[16:06] <RoyK> there's no automatic magic at this level
[16:06] <RoyK> or layer
[16:09] <bugzc> RoyK: *facepalm* :)
[16:09] <RoyK> :)
[16:10] <bugzc> I thought though on the bond driver end it would be oblivious to all that with a static ip configuration
[16:10] <bugzc> not with LACP but the other modes ive tried like tlb/rr
[16:12] <zanzacar> I was looking for a way to monitor directories. I was thinking about using inotify but I can't seem to figure it all out. Is inotify already on my system because I tried apt-get inotify and that didn't do anything.
[16:15] <RoyK> zanzacar: inotify is there
[16:15] <RoyK> zanzacar: what sort of monitoring are you trying to do?
[16:15] <zanzacar> I created a sftp chroot account and I wanted to be able to monitor it to see for uploaded files. Instead of checking through it every so often.
[16:16]  * RoyK wrote this little perl thing some time ago to monitor an ftp server's incoming dir
[16:16] <zanzacar> RoyK: did you write this? http://jmorano.moretrix.com/2012/03/watch-directory-uploaded-files/
[16:16] <RoyK> zanzacar: you can script that easily
[16:16] <RoyK> no, not me
[16:16] <zanzacar> that is one of the things I saw, but since I am much more familar and like python more i figured this would work http://pyinotify.sourceforge.net/
[16:17] <RoyK> zanzacar: you setup a monitor for the directory and wait for a create, when that happens, setup another for the file created and monitor for file close, then do your stuff
[16:18] <zanzacar> seems reasonable. but all this is based off inotify correct?
[16:19] <germanstudent> Hey. I set up a WebDAV virtual host for apache2. Now I can only delete / change files in that webdav folder if I change permissions to 777. Is there another way to avoid getting 403 forbidden in my WebDAV client?
[16:20] <RoyK> zanzacar: you hook up to the inotify in kernels, yes
[16:20] <RoyK> germanstudent: not sure, perhaps some can tell at #httpd
[16:20] <zanzacar> RoyK: ok so inotify isn't something I can run by myself from the terminal since it is already part of the kernel.
[16:20] <germanstudent> Thanks RoyK
[16:21] <RoyK> zanzacar: inotify is a kernel interface, so no, it's not a userspace thing
[16:21] <RoyK> or kernel api or whatever
[16:21] <zanzacar> interesting this is all new to me
[16:21] <RoyK> http://en.wikipedia.org/wiki/Inotify
[16:22] <RoyK> there are APIs for most programming languages
[16:23] <zanzacar> cool thanks I will have to read up on it. Thank you.
[16:23] <RoyK> so pick your choice - python? perl? c?
[16:23] <zanzacar> I have always enjoyed python
[16:23] <RoyK> then stick to it :)
[16:23]  * RoyK sticks to perl
[16:23] <RoyK> out of old habit
[16:24] <zanzacar> gotcha, I don't know perl I only know python and it hasn't failed me yet.
[16:24] <RoyK> then just use it :)
[16:25]  * RoyK doesn't like wars, neither distro wars, programming language wars or otherwise
[16:25] <RoyK> editor wars, though...
[16:26] <zanzacar> ya for sure. thank you for your help. Now that I know what I am dealing with I can move forward. I appreciate it.
[16:26] <zanzacar> not sure what an editor war is.
[16:26] <RoyK> :)
[16:26] <RoyK> well, talks about vim versus emacs are common
[16:26]  * RoyK is higly addicted to vim
[16:28] <zanzacar> gotcha gotcha gotcha I definetly can say I enjoy vim over anything else.
[16:28] <ScottK> Nothing to have an editor war about really.  The Emacs people are just wrong.
[16:29] <ScottK> ;-)
[16:29] <RoyK> ScottK++
[16:32] <zanzacar> haha
[16:32] <zanzacar> well thanks I really appreciate the help/nudge in the correct direction. Always appreciated.
[16:43] <bitbyte> any of you guys know libmemcache6 ?
[16:49] <bitbyte> or to my question above any one good with aptitude
[16:49] <bitbyte> I've got a package which seems its missing form there
[16:49] <bitbyte> from*
[17:04] <ScottK> bitbyte: What's the exact error you're getting?  Please pastebin it.
[17:04] <bitbyte> http://pastebin.com/ksn1XZvq
[17:04] <bitbyte> its on paste bin in there
[17:04] <bitbyte> when trying to apt-get sogo
[17:38] <ScottK> looking
[17:39] <ScottK> bitbyte: What release are you on?
[17:39] <bitbyte> Ubuntu 12.10 (GNU/Linux 3.5.0-28-generic x86_64)
[17:43] <ScottK> bitbyte: The sogo in 12.10 depends on libmemcached10, which does exist.  Where are you trying to get the package from?
[17:44] <bitbyte> I'm following http://www.thefanclub.co.za/how-to/how-setup-ubuntu-business-box-server-ubb-part-2
[17:45] <bitbyte> and just doing command sudo apt-get install sogo sope4.9-gdl1-mysql memcached rpl
[17:54] <ScottK> bitbyte: Those instructions tell you to add deb http://inverse.ca/ubuntu precise precise to your sources.list.
[17:54] <ScottK> You aren't on precise, so sogo built for precise (12.04) isn't installable on 12.10 due to the libmemcached library change.
[17:54] <ScottK> I'd check and see if they have a package for quantal.
[17:57] <bitbyte> so in theory if i change the package to precise it should install
[17:59] <ScottK> In theory, yes, but then you're using memcached which is using the newer libmemcached and so it starts to get complicated.
[17:59] <ScottK> Alternately, remove that repository, sudo apt-get update and then sudo apt-get install sogo
[18:00] <ScottK> sogo wasn't in the official repositories fro 12.04, but it is for 12.10.
[18:00] <bitbyte> ok well ill try removing and see how it goes
[18:00] <bitbyte> thanks
[18:01] <bitbyte> well soho is installing but it does complain about not finding sope4.9-gdl1-mysql
[18:04] <RoyK> bitbyte: I'd recommend using LTS releases for servers :P
[18:04] <bitbyte> they should already be there
[18:05] <ScottK> Or at least if you're following a guide for 12.04 and are on 12.10, you should expect to have to make some adjustments.
[18:05] <patdk-lap> heh, some :)
[18:05] <bitbyte> http://pastebin.com/VHjPzT6Z
[18:05] <bitbyte> there the packages on right now
[18:12] <bitbyte> thanks for the help anyway guys ill tinker later with it
[18:30] <aarcane> I've got about 2 dozen packages on my server tagged as ip or id.  THey show up in aptitude search '~g', but when I try to purge them, using aptitude purge '~g', nothing is purged.
[18:33] <maxb> Those letter codes don't seem quite right to me if they are what I guess them to be...... are you sure / give more context?
[18:35] <maxb> Oh, right
[18:35] <maxb> How helpful, aptitude uses similar yet different codes to dpkg
[18:40] <maxb> Well, if you want to review and run pending aptitude actions, I'd say using the interactive aptitude UI is the nicest way, though you could also go for 'aptitude install'
[19:01] <germanstudent> Is there any way to get inotify working for remote FUSE/sshfs directorys
[20:36] <yofun> can i reinstall my VPS server via ssh. from ubuntu 12.10 x86_64 to ubuntu 12.10 x86?
[20:37] <Ben64> no
[20:37] <Ben64> why would you even want to
[20:47] <yofun> Ben64:  becasue the service im trying to run works better on 32bit and atm i cant access my VPS control panel
[21:08] <wting> Hey, my Ubuntu server keeps freezing every 30 minutes and I need to do a hard reboot. How do I diagnose random crashes?
[21:10] <wting> I thought it might be the native zfs package, but I've been stress testing my pool and I can't crash it. However running rtorrent will consistently crash within an hour.
[21:13] <wting> I've uploaded the kern.log here, not sure what other logs are important: http://temp.ancientpc.net/kern.log
[22:40] <RobbyF> qexit
[22:41] <RobbyF> wrong window.
[22:52] <krys> anyone feel like helpping me with a system that wont boot?
[22:52] <krys> after the grub menu it just reboots, doesnt give me any error
[22:53] <krys> already tried repairing grub with the rescue-disk
[22:54] <krys> i have the disk mounted on another system and can access the file system, so its not a disk issue
[22:57] <krys> nobody home?
[23:02] <lenios> krys, can you modify grub options?
[23:03] <lenios> i mean, modify the linux line on the grub entry
[23:06] <bugzc> RoyK: thanks for the assistance earlier and thanks to everyone else.
[23:18] <krys> lenios: probably
[23:18] <krys> what should I try?
[23:18] <krys> i used the boot-repair disk already thinking that would fix it but it didny
[23:19] <krys> ditn*
[23:19] <krys> didnt*
[23:19] <krys> i just dont understand why i dont get any error messages or anything
[23:54] <krys> weird, i ran all grub commands manually expecting to see an error message, same thing... no error just an reboot


[20:07] <pdbogen> Howdy! There's a patch in Linux 5.4.53 that addresses a kernel panic we experience on bionic w/ `linux-image-aws-edge`; is there any guidance on when we might see the patch available from ubuntu?
[20:08] <pdbogen> (this one, if that's helpful: https://patchwork.ozlabs.org/project/netdev/patch/20200702185256.17917-1-xiyou.wangcong@gmail.com/)


[13:12] <mastier> Sorry, bothering you, but maybe some dev got the idea why the hell it's not working as expected
[13:12] <mastier> http://stackoverflow.com/questions/40979937/cloud-init-datasource-setting-timeout-doesnt-work


[06:42] <zequence> Beta testing today, anyone? I'll be testing no later than lunch myself.
[13:24] <zequence> Did very quick testing, and found that reboot was impossible after install, like was a general case at least with Xubuntu as well.
[13:24] <zequence> Will mark ready a bit later, if no one else begins testing.


[04:19] <lotuspsychje> good morning to all
[04:21]  * Bashing-om present - though un-accounted for :)
[04:22] <lotuspsychje> hey Bashing-om
[04:22] <lotuspsychje> only coffee and sleep can rescue us
[04:24] <Bashing-om> Oh I am adicted to irc . there is no saving me ( ask my other half !)
[04:24] <lotuspsychje> lol
[04:25] <lotuspsychje> my other half doesnt wanna go to work
[04:27] <Bashing-om> lotuspsychje: We are both retired, but I tell ya .. trying to live on Social security is not cutting it . One of us is going to have to find gainful employment :)
[04:28] <lotuspsychje> lol
[05:11] <lotuspsychje> gtg work  laterz guys
[06:24] <ducasse> morning all
[07:23] <EriC^^> morning
[07:25] <ducasse> good morning, EriC^^ - all well?
[07:26] <EriC^^> yup thanks you?
[07:27] <ducasse> good here, reading mail and relaxing.
[07:29] <EriC^^> cool
[07:31] <ducasse> now i'm being used for climbing on :)
[07:39] <EriC^^> hehe
[11:27] <BluesKaj> Hiyas all
[14:10] <ducasse> installing kernels from a google plus forum - seems like a smart move...
[14:53] <pauljw> Hi everyone
[15:13] <BluesKaj> 'Morning pauljw :-)
[15:24] <pauljw> hey BluesKaj, sorry stepped away... :)
[17:00] <immu> hi all amigos :)
[17:54] <immu> ducasse, hi lordievader hi
[17:54] <immu> BluesKaj, hey
[17:56] <BluesKaj> hi immu
[18:01] <immu> its quite in here? are you watching something
[18:25] <EriC^^> good evening everyone
[18:26] <daftykins> hi hi!
[18:27] <oerheks> :-)
[18:28] <EriC^^> hi guys :)
[18:28] <ducasse> \o
[18:28] <EriC^^> hey ducasse
[18:37] <BluesKaj> hi EriC^^
[18:38] <EriC^^> hi BluesKaj
[18:38] <BluesKaj> daftykins
[18:38]  * daftykins sips a smooth merlot
[18:38] <BluesKaj> and oerheks
[18:39] <daftykins> :)
[19:38] <pauljw> Hi everyone


[01:42] <RAOF> Huh.
[01:42] <RAOF> ProtobufMessageProcessor really is entirely untested.
[05:52] <duflu> Why is it "bzr log FILE" often shows revisions that have nothing to do with FILE?
[06:03] <RAOF> It does?
[06:08] <duflu> RAOF: Yes, more often than not. So bzr log FILE is mostly useless
[06:08] <duflu> Seems like a bug
[06:08] <duflu> If I analyse the revisions it gives me then FILE is not in them
[06:09] <RAOF> Huh. Do you have an example file? I've never seen that.
[06:09] <RAOF> (And I do occasionally do bzr log FILE)
[06:11] <duflu> RAOF:  bzr log src/shared/protobuf/mir_protobuf_wire.proto
[06:12] <RAOF> Hm, quite true.
[06:12] <RAOF> Odd.
[06:12]  * duflu experienced git again for the first time in a long time last night. It was nice :)
[14:12] <tkamppeter> I have submitted a MIR for the "brlaser" printer driver package (bug 1359137). I would like to get it in before FF. The package is super simple and small. Could this be done? I have already posted on #ubuntu-release but did not get any answer.
[14:13] <tkamppeter> I hope this is about "Main Inclusion Request", if not, tell me which channel is the correct one.
[14:16] <greyback> tkamppeter: this channel is about Mir, the display server, not MIRs
[14:16] <greyback> tkamppeter: #ubuntu-devel probably better channel
[14:19] <alan_g> kdub: when you could reproduce lp:1358698 - was it on desktop or phone?
[14:19] <kdub> alan_g, it was on phone
[14:20] <kdub> and I tried bisecting, but at some point the process of updating binaries fixed the problem for me
[14:20] <kdub> i can see if i can reproduce again, seems its giving us a headache
[14:20] <alan_g> kdub: I remember that - just wasn't sure where you were running it
[14:22] <alan_g> kdub: BTW welcome back - I trust you're fully recovered>?
[14:23] <kdub> alan_g,  yeah, enough that cold/flu medicine takes care of the remaining symptoms
[14:42] <tkamppeter> greyback, OK.
[15:20] <alan_g> does anyone know why we dlopen our platform plugins with RTLD_GLOBAL when we're going to use dlsym to resolve the symbols?
[15:22]  * alan_g sees that bzr says alf_ wrote that.
[15:43] <AlbertA2> alan_g: I think I tried removing it once
[15:44] <AlbertA2> and I got loading errors in unity8
[15:44] <AlbertA2> but I can't remember for sure
[15:44] <AlbertA2> I vaguely remember something to do with the fact that unity-mir is also loaded at runtime
[15:47] <alan_g> AlbertA2: It seems strange, but I can wait for an explanation (as it isn't causing the problem).
[15:47] <alan_g> I hope
[15:48]  * alan_g is glad he's not the only one to ever wonder
[15:53] <greyback> AlbertA: unity-mir dead. Qtmir (its replacement) is not dl-loaded
[15:56] <AlbertA2> greyback: right...I was just recalling some months ago when I tried removing RTLD_GLOBAL
[15:57] <AlbertA2> but there may be some other reason it's there
[16:00] <AlbertA2> racarr_: thanks for the help, worked like a charm :) https://code.launchpad.net/~albaguirre/mir/fix-1359264/+merge/231584
[16:03] <greyback> AlbertA: gotcha
[16:03] <AlbertA2> greyback: oh I wanted to ask you where in qtmir is the wait for first frame? curious...
[16:04] <greyback> AlbertA: http://bazaar.launchpad.net/~mir-team/qtmir/trunk/view/head:/src/modules/Unity/Application/mirsurfaceitem.cpp#L384
[16:05] <greyback> AlbertA: which is called by a Mir SurfaceObserver::frame_posted
[16:05] <greyback> http://bazaar.launchpad.net/~mir-team/qtmir/trunk/view/head:/src/modules/Unity/Application/mirsurfaceitem.cpp#L226
[16:06] <AlbertA2> thanks!
[16:07] <greyback> we then have code in MirSurfaceManager to only add the surface to the scene once the first frame is posted
[16:08] <AlbertA2> greyback: and is there an easy way to cross-compile qtmir?
[16:08] <greyback> AlbertA: I sbuild it usually
[16:08] <greyback> or else develop on device, since it's pretty small :)
[16:10] <AlbertA2> so qmake and then make?
[16:11] <greyback> hang on, you need to be careful to use gcc4.9
[16:11] <greyback> qmake "QMAKE_CXX=arm-linux-gnueabihf-g++-4.9" "QMAKE_LINK=arm-linux-gnueabihf-g++-4.9" "QMAKE_LINK_SHLIB=arm-linux-gnueabihf-g++-4.9"
[16:11] <greyback> then make
[16:11] <greyback> make install
[16:12] <AlbertA2> ahh thanks!
[16:22]  * alan_g has managed to reproduce bug 1358698 (and it's only Wednesday!)
[16:25] <kdub> alan_g, yay
[16:35] <alan_g> kdub: I got excited too soon. It happened twice - now with the same *binaries* I can't reproduce.
[16:35] <kdub> hmm, so a fun transient problem
[16:41]  * kdub goes on the case too
[16:42] <alan_g> kdub: I have a theory about the time I got it...
[16:43] <alan_g> The test discovery code died with it
[16:43] <alan_g> and that ran *before* the libmirplatformgraphics library was created
[16:44] <kdub> missed something, before the library was created?
[16:44] <alan_g> so if we load a libmirplatformgraphics which depends upon a *different* version of libmircommon
[16:44] <alan_g> yes
[16:45] <alan_g> There's no dependency in cmake on the platformgraphics library
[16:45] <alan_g> Because that is dlopened
[16:45] <alan_g> and no-one added a rule
[16:45] <alan_g> so if we load a libmirplatformgraphics which depends upon a *different* version of libmircommon
[16:46] <alan_g> then we could be getting two versions of libmircommon in memory
[16:46] <alan_g> *BOOM*
[16:46] <alan_g> But that timing doesn't explain all the CI failures
[16:47] <kdub> yeah, its a reasonable explanation, but I don't see how the problem could be transient
[16:47] <alan_g> Once the libmirplatformgraphics has been built the problem goes away
[16:47] <alan_g> as we pick up the right one
[16:52] <alan_g> Anyway, if that is actually the cause then the latest rev of this ought to pass CI: https://code.launchpad.net/~alan-griffiths/mir/integration-and-unit-tests-link-against-internals/+merge/230810
[16:52] <racarr_> AlbertA2: Yay :) will review
[16:52] <racarr_> *
[16:52] <racarr_> whoops
[16:53] <alan_g> But it doesn't (yet) explain why CI consistently goes wrong and we have a rare intermittent.
[16:54] <kdub> maybe its a fresh install everytime? (trying to think what that could change)
[16:55]  * alan_g is tempted to revert -c1846 just to see if that masks the problem
[16:58] <alan_g> kdub: another MP may shed light (but I expect it to eliminate an idea, not provide a solution): https://code.launchpad.net/~alan-griffiths/mir/fix-1358698/+merge/231423
[16:58] <alan_g> but I'm hitting EOD and hope it to be solved when I get into work tomorrow. ;)
[17:00] <AlbertA2> greyback: what's your incantantion for sbuild - it keeps failing here on getting the dependencies
[17:02] <greyback> AlbertA: hmm let me check here first. I usually do "sbuild -c utopic-amd64-armhf --host=armhf -j3" ut it's been a while
[17:06] <greyback> AlbertA: failed for me on g++4.9 - same for you? I had hoped that was fixed by now.
[17:07] <AlbertA2> greayback: yeah
[17:08] <greyback> https://bugs.launchpad.net/ubuntu/+source/mir/+bug/1353855
[17:09] <greyback> I can't recommend anything else except working on device, sorry
[17:10] <AlbertA2> greyback: thanks...
[17:15] <AlbertA2> greyback: though for me is failing on mor than just g++4.9: http://paste.ubuntu.com/8099543/
[17:15] <AlbertA2> which makes me think I'm missing something else as well
[17:17] <racarr_> you could install the needed dependencies
[17:17] <greyback> hmm. My output for comparison, in case it helps: http://pastebin.ubuntu.com/8099553/
[17:17] <racarr_> in a prepopulated sbuild
[17:17] <racarr_> and then remove all the build-deps from debian/rules before running sbuild
[17:17] <racarr_> lol...
[17:17] <racarr_> ridiculous of course but its become
[17:17] <greyback> back in your cage you!
[17:17] <racarr_> really hard to build on device imo
[17:17] <racarr_> there is barely enough space
[17:17] <racarr_> for mir/qtmir build deps
[17:17] <racarr_> anymore
[17:18] <greyback> true, I just about squeeze it in these days
[17:18] <racarr_> and last time I actually only managed to do it by manually deleting a bunch of stuff from /usr/lib lol
[17:18] <racarr_> but I think I had some stuff
[17:18] <racarr_> left over too
[17:18] <greyback> apt-get clean if your friend
[17:18] <racarr_> lol
[17:18] <racarr_> I know even with rming /var/cache/apt/archives
[17:18] <racarr_> though
[17:18] <racarr_> unless apt-get clean does more
[17:18] <greyback> think it's the same
[17:18] <racarr_> lol, anyway, I hope we can make sbuild work...
[17:18] <greyback> it's been like that for >1 month now
[17:19] <greyback> it'll probably go away if 4.9 made default
[17:41] <AlbertA2> umm the weird part is g++-4.9 is already installed in the chroot
[17:42] <racarr_> it's the cross compile chain v. armhf binary or some such right?
[17:42] <racarr_> (it's->the problem is)
[17:42] <mibofra> AlbertA2, hi :D, recompiling mir wasn't successful xD. And I think you (you as the developers/engineers of the mir's team) do not want to support a chroot environment XD .
[17:44] <AlbertA2> mibofra: log?
[17:46] <AlbertA2> racarr_: oh yeah...
[17:48] <mibofra> AlbertA, the same results of the demos provided by executables on the packages, do you remember them?
[17:49] <AlbertA2> mibofra: oh so you were able to compile fine, just failure at run time again?
[17:49] <greyback> AlbertA: the amd64 g++ is installed, but it's trying to install the armhf one. I tried this cheeky patch: http://pastebin.ubuntu.com/8099582/ but it failed further on with qmake not being found (wrong arch installed)
[17:51] <mibofra> yeah AlbertA2, apart from a compiling issue that I had to fix (the system was an make's assassin xD, so I've free other sources for make and it (make) ran fine).
[17:52] <AlbertA2> mibofra: well if you can step through the egltriangle example with gdb
[17:52] <AlbertA2> mibofra: since the stack trace was pretty useless
[17:52] <AlbertA2> mibofra: it could help us narrow down the issue...
[17:53] <mibofra> yeah it was, let's see
[19:06] <AlbertA2> kgunn_: was there a bug# for the dash flash when opening apps?
[19:07] <kgunn_> uh yeah, i know daniel logged one....lemme look
[19:13] <mibofra> AlbertA2, apart form the stacks what do you find useful/ do you need/ do you debug usually?
[19:13] <AlbertA2> logcat and dmesg...specially if it's a driver issue...
[19:13] <AlbertA2> but in your case it's a client side issue...
[19:15] <mibofra> AlbertA2, we've seen the dmesg, the output of logcat it's regular http://paste.ubuntu.com/8100365/
[19:15] <AlbertA2> right...
[19:15] <AlbertA2> so stepping through does not help?
[19:21] <kdub> our mp's are outta control
[19:21] <AlbertA2> kdub: only 24... ;)
[19:23] <AlbertA2> greyback: so it was indeed the first blank frame causing the dash flash
[19:23] <AlbertA2> greyback: https://code.launchpad.net/~albaguirre/qtmir/ignore-first-frame/+merge/231612
[19:24] <greyback> AlbertA2: yep saw that, but I'm very curious why Mir gives us a "frame drawn" notification, and the first frame we pull is not drawn to
[19:25] <AlbertA2> greyback: I seem to recall, but not entirely sure
[19:25] <AlbertA2> that we are getting a swap buffers from qt...without actual content...so the framework just goes through the motions...
[19:26] <AlbertA2> but I have to check again...so much has changed
[19:26] <racarr_> lol CI went on a crazy run through everytrhing
[19:26] <mibofra> AlbertA2, I've to try every option of gdb xD but if you want I can setup an ssh access so you can try other things (if you want).
[19:27] <AlbertA2> greyback: or it could just be the driver doing that as well...
[19:28] <greyback> AlbertA2: it's Mir's job to try isolate me from driver quirks :)
[19:28] <AlbertA2> mibofra: well if you could narrow it down to a top level call at least, to see if it's just driver setup or a call in mir
[19:28] <greyback> AlbertA2: I'm not against the patch, but IMO it needs a big FIXME/HACK comment and an associated Mir bug
[19:28] <AlbertA2> greyback:  :)=
[19:29] <greyback> AlbertA2: you're sure skipping just 1 frame is enough?
[19:29] <AlbertA2> greyback: yeah I'll dig deeper but for now that should do...
[19:29] <AlbertA2> greyback: yeah it's only the first frame... I tested on n10 and others
[19:31] <AlbertA2> greyback: well the thing I'm not sure it's a mir bug yet, like I said, I think alan or alf suspected Qt calling swap_buffers
[19:31] <AlbertA2> before rendering any content at the begninning
[19:31] <AlbertA2> but this was some months ago
[19:32] <greyback> AlbertA2: hmm first I've heard of that. Is possible
[20:54] <mibofra> AlbertA2, a thing, if you want I can say to you how I've setup my chroot (enviroment)
[20:54] <AlbertA2> mibofra: sure
[20:54] <mibofra> *environment
[20:54] <mibofra> AlbertA2, so you can maybe reproduce it and test it yourself
[21:01] <mibofra> AlbertA2, initially I've used this project: http://botbrew.com/ , and this app https://play.google.com/store/apps/details?id=com.botbrew.basil (with source on https://github.com/jyio/botbrew-gui). Basically it bootstrap a copy of emdebian (not even developed form july), and automatize the chroot process, binding /dev /sys /proc ecc.., so it's simple to replace emdebian with ubuntu touch or other systems.
[21:04] <mibofra> I had some issues with use some functions of the app, like install some parts of emdebian, some parts required some manual interventions that couldn't be done except from an shell with adb or a terminal emulator.
[21:05] <AlbertA2> greyback: so yeah it was a bug in mir: https://bugs.launchpad.net/mir/+bug/1359406
[21:05] <AlbertA2> mibofra: ok... but what is the initial platform?
[21:05] <mibofra> but ubuntu touch it's basically complete for use, so you don't need to fix nothing apart from manually replace the emdebian with ubuntu touch
[21:06] <mibofra> AlbertA2, I really didn't understand you with this question lol
[21:06] <mibofra> what do you mean?
[21:06] <AlbertA2> mibofra: is it a rooted android phone? or you already have ubuntu touch running on it? or something else?
[21:07] <mibofra> AlbertA2, I've said it before, it's an android (cyanogenmod 11) rooted phone.
[21:07] <AlbertA2> oh I see...and android app
[21:07] <AlbertA2> ok...
[21:09] <AlbertA2> mibofra: so the app does all the setup for you?
[21:09] <AlbertA2> mibofra: nothing else needed?
[21:09] <mibofra> AlbertA2, anyway basically only mir doesn't work, pulse works, network manager too, dbus too
[21:12] <mibofra> AlbertA2, yeah it's much less work to do. You've only to use the first option of the app
[21:12] <racarr_> Your problem could relate to...well...
[21:12] <racarr_> if the app is for running debian
[21:12] <racarr_> I dont see why it would bother setting up the appropriate
[21:12] <racarr_> symlinks for /system
[21:12] <racarr_> to the androit root...
[21:13] <AlbertA2> racarr__: but render_to_fb is working though
[21:13] <racarr_> ah damnit
[21:13] <AlbertA2> racarr__: so the server seems ok
[21:13] <racarr_> lol
[21:13] <AlbertA2> it's the client driver context
[21:13] <mibofra> AlbertA2, the deployed system will be under /data/botbrew-basil in default
[21:13] <racarr_> I was going to guess wrong libGL
[21:13] <racarr_> :(
[21:13] <racarr_> hmm
[21:13] <AlbertA2> that crashes
[21:13] <racarr_> I wonder if ubuntu touch runs natively on the device
[21:13] <racarr_> e.g. community port
[21:14] <AlbertA2> mibofra: have you tried runing the egltriangle example with sudo?
[21:14] <AlbertA2> just to rule out permission issues
[21:14] <racarr_> ohhh there isa theory
[21:14] <AlbertA2> mibrofra: ok and then you chroot into that dir?
[21:15] <mibofra> racarr_, the server can load the necessary libraries, http://paste.ubuntu.com/8101160/ and the demo render_to_fb works and I can see the output on the screen.
[21:16] <mibofra> AlbertA2, basically I work with root only at the moment
[21:16] <AlbertA2> mibofra: ok..
[21:16] <mibofra> even if I can add and login with normal users
[21:17] <mibofra> racarr_, there is a port of utouch for my phone (the gt-i9300), without ril support but there is. Anyway the logic is that if I can run ubuntu touch in this way, every user of an arm7 phone/tablet will be able to use ubuntu touch without porting it.
[21:19] <racarr_> mm would be neat
[21:19] <mibofra> (anyway the porting for my phone it's discontinued xD )
[21:20] <mibofra> racarr_, and I like the concept to put an hdmi adaptor, a pair of bluetooth keyboard and mouse and see unity on the screen of my lcd hd TV and use my phone as my desktop pc xD
[21:24] <mibofra> racarr_, yeah think about this, you deploy ubuntu touch under android, and use it without porting and maybe switch between the os by a script that route the hw (start/stop the services on both the os) and you can "dualboot" without rebooting the phone
[21:25] <AlbertA2> mibofra: motorola did that actually a few years ago :)
[21:26] <mibofra> racarr_, and the devices are shared with both the so, so for example, I've used xboxdrv to use the wireless xbox receiver and controller and android seen it and I can use it on android. Or ubuntu touch can use the fm receiver or the nfc chip without developing the support for each device.
[21:27] <mibofra> AlbertA2, yeah and I think it's an intelligent thing
[21:28] <mibofra> AlbertA2, an maybe less pain for you devs/engineers, basically with this approach every arm7 device that runs andorid it's virtually supported
[21:28] <mibofra> :)
[21:28] <AlbertA2> mibofra: well that's the approach we take already...we use the android binary blobs
[21:29] <AlbertA2> for modem, display, etc...
[21:29] <AlbertA2> but the devil is on the details...
[21:29] <AlbertA2> specially display drivers
[21:30] <AlbertA2> they all have different caveats/bugs...
[21:30] <mibofra> AlbertA2, yeah xD . And I hate a thing
[21:31] <mibofra> Basically every linux system can mange the modules with modprobe and the other tools
[21:31] <mibofra> on /system/lib there are the libs ok but there isn't the index lib as on every linux system
[21:32] <mibofra> so if you try a modprobe module that's the response: modprobe: ERROR: ../libkmod/libkmod.c:557 kmod_search_moddep() could not open moddep file '/lib/modules/3.0.64-CM-g8245168/modules.dep.bin'
[21:32] <AlbertA2> well that's an android thing
[21:34] <mibofra> ok AlbertA2 but why don't use an "tested" approach of the modules managing?
[21:35] <AlbertA2> I guess that's a google question :)
[21:36] <mibofra> AlbertA2, I think they have fun to see the devs imprecate porting android on other devices that aren't the nexus series xD.
[21:38] <mibofra> AlbertA2, just a thing I've remembered, where is gone ubuntu for TVs?
[21:43] <mibofra> just to curiosity (yes I'm curious)
[21:43] <AlbertA2> mibofra: I don't know...that's more of a roadmap question...
[21:43] <mibofra> *for
[21:43] <mibofra> ok
[22:24] <mibofra> AlbertA2, anyway I'm here if you have any ideas.


[01:04] <rick_h> dannf: charm proof say anything?
[01:05] <rick_h> dannf: in looking at my shell history I've not had to, but wonder if you can force a bundle by charm push . cs:~ce-hyperscale/bundle/openstack-base-d05
[15:10] <dannf> rick_h: FATAL: No bundle.yaml (Bundle) or metadata.yaml (Charm) found, cannot proof
[15:11] <dannf> rick_h: i'm getting the feeling this is a snap issue, i'll file a bug
[15:11] <rick_h> dannf: hmm yea that was next would be to be more explicit than . and see if that's helpful
[15:13] <dannf> rick_h: yeah - appears that the problem is that i was working in /tmp. i moved the bundle dir to my home dir, and it worked
[15:13] <rick_h> dannf: hmm, yea that's helpful details for the bug to repro it
[20:08] <kwmonroe> bdx: did you ever figure out graylog (https://bugs.launchpad.net/graylog-charm/+bug/1714114)?
[20:08] <mup> Bug #1714114: no way to access web url without reverse proxy, no docs for reverse proxy <conjure> <Graylog Charm:Confirmed> <https://launchpad.net/bugs/1714114>
[20:08] <kwmonroe> i've related it to every proxy under the sun, but can't even get to a login screen.
[21:03] <[Kid]> in the bundle.yaml, in the line "charm: "cs:~containers/kubernetes-master-6" does the 6 mean anything, or is it a random number?
[21:03] <[Kid]> i realize it will build a container from the kubernetes charm in the charm store
[21:11] <rick_h> [Kid]: yea the 6 is the revision of the kubernetes-master charm
[21:11] <rick_h> [Kid]: as the team.updates the charm it'll increase over time.


[09:44] <jibel> sil2100, hi, could you copy latest build of desktop canary somewhere please?
[09:48] <sil2100> jibel: o/
[10:04] <sil2100> jibel: https://people.canonical.com/~platform/ubuntu-canary/20190606/
[10:31] -queuebot:#ubuntu-release- New binary: kubuntu-wallpapers [amd64] (eoan-proposed/universe) [19.10.1] (kubuntu)
[10:34] <jibel> sil2100, thanks
[10:53] -queuebot:#ubuntu-release- Unapproved: accepted partman-iscsi [source] (disco-proposed) [40ubuntu<IP_ADDRESS>]
[10:54] -queuebot:#ubuntu-release- Unapproved: accepted partman-iscsi [source] (cosmic-proposed) [40ubuntu<IP_ADDRESS>]
[10:55] -queuebot:#ubuntu-release- Unapproved: accepted partman-iscsi [source] (bionic-proposed) [40ubuntu<IP_ADDRESS>]
[11:30] <marcustomlinson> hey sil2100, pretty please could you have a look at my bionic and cosmic LibreOffice SRUs today? It's a small fix but high impact
[12:25] -queuebot:#ubuntu-release- New source: grubzfs-testsuite (eoan-proposed/primary) [0.2]
[12:31] -queuebot:#ubuntu-release- New: rejected grubzfs-testsuite [source] (eoan-proposed) [0.1]
[12:31] <didrocks> 0.2 replaces 0.1 as it wasn't reviewed yet ^ If someone has the time to review it, that would be great.
[13:35] -queuebot:#ubuntu-release- Unapproved: neutron (disco-proposed/main) [2:14.0.0-0ubuntu1.1 => 2:14.0.1-0ubuntu1] (openstack, ubuntu-server)
[15:51] <jibel> xnox, on desktop canary images BOOT is not set because there is no default-boot-to-casper.conf certainly because CASPER_GENERATE_UUID is not set. What and where is it set? We searched in casper, ubuntu-cdimage, debian-cd and livecd-rootfs but found nothing.
[15:52] <xnox> jibel:  muahahahahhahaha
[15:55] <sil2100> cpaelzer: hey! The qemu uploads has some non-SRUenabled bugs, could you SRU-enable those?
[15:58] <jibel> xnox, ?
[15:58] <xnox> jibel:  let me find it. it was tricky the first time around
[15:59] <jibel> okay :)
[15:59] <didrocks> that's what we guessed, looking for the value :) wondering if it's not hardcoded somewhere on buildds ;)
[15:59] <cjwatson> if it were you'd find it in lp:launchpad-buildd (but it isn't)
[16:00]  * didrocks wonders if cjwatson has a hilight on buildd! However, good reference repo to note down, thx
[16:01] <cjwatson> I read most channels I'm in :)
[16:03] -queuebot:#ubuntu-release- Unapproved: accepted mesa [source] (disco-proposed) [19.0.2-1ubuntu1.1]
[16:05] <xnox> doko:  we cannot hear you
[16:05] <xnox> doko:  please type
[16:06] -queuebot:#ubuntu-release- Unapproved: rejected mesa [source] (bionic-proposed) [19.0.2-1ubuntu1.1~18.04.1]
[16:12] <Eickmeyer> sil2100: FYI, the two archs FTBFAA aren't show-stoppers, nor are they supported upstream, hence they were approved.
[16:12] <Eickmeyer> RE: lsp-plugins
[16:22] <xnox> jibel:  in your list of searches you are missing "live-build" =)
[16:22] <xnox> jibel:  live-build-3.0~a57/scripts/build/lb_chroot_hacks:		UPDATE_INITRAMFS_OPTIONS="CASPER_GENERATE_UUID=1"
[16:22] <xnox> jibel:  which as far as i understand what generated the final initrd that is spitted out of livebuild.
[16:23] <xnox> jibel:  note that uuid from the initrd, is then extracted and placed on disk itself as well.
[16:23] <xnox> jibel:  do you want me to look into unbreaking canary images to generate initrds with uuid?
[16:23] <xnox> (for desktop, on subiquity side we generate multiple initrds, so we do it by hand)
[16:25] <jibel> xnox, thanks, that would be great if you could unbreak it.
[16:36] <sil2100> Eickmeyer: hm, ACK
[17:09] -queuebot:#ubuntu-release- New: accepted kubuntu-wallpapers [amd64] (eoan-proposed) [19.10.1]
[17:12] <Eickmeyer> infinity, vorlon: Is the lack of ppc64el and s390x what's hanging-up lsp-plugins in proposed?
[17:12] <infinity> Eickmeyer: No, I'm reviewing the binaries right now.
[17:12] <Eickmeyer> infinity: Ah, thanks
[17:16] -queuebot:#ubuntu-release- New: accepted lsp-plugins [amd64] (eoan-proposed) [1.1.9-0ubuntu2]
[17:16] -queuebot:#ubuntu-release- New: accepted lsp-plugins [armhf] (eoan-proposed) [1.1.9-0ubuntu2]
[17:16] -queuebot:#ubuntu-release- New: accepted lsp-plugins [arm64] (eoan-proposed) [1.1.9-0ubuntu2]
[17:16] -queuebot:#ubuntu-release- New: accepted lsp-plugins [i386] (eoan-proposed) [1.1.9-0ubuntu2]
[17:17] <Eickmeyer> \o/
[17:17] <infinity> vorlon: '/lastlog ceph' suggests you'd started a binary NEW review of ceph and then aborted.  Did you want to keep context on that and see it through, or hand it off?
[17:17] <vorlon> infinity: aside from the onerous download time from the queue I have no other context of import
[17:18] <infinity> Mmkay.
[17:18] <vorlon> infinity: the answer I got says that I can't do a cursory review based on something that's been judged good in Debian
[17:25] -queuebot:#ubuntu-release- Unapproved: accepted xserver-xorg-video-amdgpu-hwe-18.04 [source] (bionic-proposed) [19.0.1-1~18.04.1]
[17:26] -queuebot:#ubuntu-release- Unapproved: accepted xserver-xorg-video-ati-hwe-18.04 [source] (bionic-proposed) [1:19.0.1-0ubuntu1~18.04.1]
[17:27] -queuebot:#ubuntu-release- Unapproved: accepted xserver-xorg-video-nouveau-hwe-18.04 [source] (bionic-proposed) [1:1.0.16-1~18.04.1]
[17:55] -queuebot:#ubuntu-release- Unapproved: mesa (bionic-proposed/main) [19.0.2-1ubuntu1~18.04.1 => 19.0.2-1ubuntu1.1~18.04.1] (core, xorg)
[18:01] <vorlon> RikMills[m], tsimonq2: you've seen that kubuntu daily is oversized now in eoan?
[18:03] <vorlon> incidentally, since flavor leads were discussed in the TB meeting this week, I notice that http://iso.qa.ubuntu.com/admin/config/services/qatracker/series/68/manifest lists yofel, who I haven't heard from in a while.  Is he still the right contact for Kubuntu?
[18:07] <Eickmeyer> vorlon: Along those same lines, sakrecoer is no longer a contact for Ubuntu Studio.
[18:07] <Eickmeyer> You can put me down for that.
[18:09] <vorlon> Eickmeyer: done, cheers
[18:10] <Eickmeyer> vorlon: Thanks. :)
[18:21] -queuebot:#ubuntu-release- Unapproved: accepted mesa [source] (bionic-proposed) [19.0.2-1ubuntu1.1~18.04.1]
[21:10] <tsimonq2> vorlon: I can't really speak for ISO size, that's acheronuk's department, but for contact, please put (in this order): acheronuk, valorie, ~kubuntu-council.
[21:10] <tsimonq2> vorlon: Also, a TB meeting? Whee.
[21:13] <vorlon> tsimonq2: thanks, I think it's meant to be an individual contact, so truncated this after the 2nd
[21:13] <tsimonq2> vorlon: ack


[13:48] <smoser> i'm not sure what this ailure is... but i dont think related to the pull request it came from
[13:48] <smoser>  https://travis-ci.com/github/canonical/cloud-init/jobs/421338811
[13:48] <smoser> (#640 https://github.com/canonical/cloud-init/pull/640/checks?check_run_id=1331314409)
[13:48] <AscII> yeah, I don't get it either
[13:58] <smoser> integration test failed. in colect_test_data
[13:58] <smoser> 2020-10-30 10:07:15,081 - /home/travis/build/canonical/cloud-init/tests/cloud_tests/stage.py:run_stage:102 [ERROR]: stage: collect test data for xenial encountered error: Create instance from copy: The container is already frozen
[13:58] <smoser> i hit 're-run' , but i dont know if it did anything
[14:00] <AscII> does not look like it
[14:08] <smoser> Odd_Bloke: help? ^ or blackboxsw or falcojr ?
[14:09] <Odd_Bloke> Huh, I've never seen that before.
[14:10] <Odd_Bloke> Looks like a new LXD snap did land today, so it could be an issue with that, I'll test locally.
[14:11] <smoser> hooray for "dude on the internet broke my c-i"
[14:11] <falcojr> that's why we have CI, right? ;)
[14:12] <otubo> blackboxsw: thanks for the feedback! According to https://fedorapeople.org/groups/schedule/f-34/f-34-key-tasks.html Fedora 23 will branch from Rawhide on 2021-02-09. So I guess that's time enough for at least one cloud-init release :-)
[14:12] <otubo> *Fedora 34, missclicked sorry :-)
[14:24] <Odd_Bloke> (https://github.com/lxc/lxd/commit/1cb7475c22a02f5317641c746c87430b0d561551 landed 4 days ago, seems unlikely to be a coincidence.)
[14:56] <Odd_Bloke> OK, I can reproduce it locally; I'll submit a PR to pin our `snap install lxd` at an older known-working version and then file a bug with lxd.
[14:56] <Odd_Bloke> (I expect the response will be roughly "lol pylxd" but nevertheless. :p)
[14:59] <Odd_Bloke> smoser: https://github.com/canonical/cloud-init/pull/642 <-- it's not a linter by any means, but this should at least guide people in a clearer direction?
[15:14] <smoser> Odd_Bloke: its a good idea. commented there.
[15:20] <danzarov> hello guys, does anybody know if there is a way I can perform a for loop to add users instead of specifying multiple user blocks like showed here https://cloudinit.readthedocs.io/en/20.3/topics/examples.html#including-users-and-groups
[15:21] <danzarov> i know i can use a variable type string and do something like: - name: ${username} ...and so on
[15:21] <danzarov> but still i would need to create multiple variables and multiple user blocks
[15:34] <smoser> danzarov: i think maybe if you start it with ## template: jinja you can use jinja.
[15:34] <smoser> but a simple "another layer of indirection" solves the problem too.
[15:34] <smoser> just have a program write the user-data that you provide.
[15:46] <meena> i used pylxd while developing against the go API, because go has no REPL
[16:07] <rharper> falcojr: https://github.com/canonical/cloud-init/pull/598  I approved this; it needs a rebase;  I don't see the rebase and merge button; not sure if you can do that;
[16:12] <danzarov> smoser, nice, im going to try jinja, thanks (:
[16:23] <Odd_Bloke> rharper: There should be an "Update branch" button (which would then mean you could use the "Squash and merge" button once it was up-to-date), but the submitter must have disabled the option that allows maintainers to push to their branch.  That means we're reliant on them updating the branch for landing.
[16:23] <rharper> ah
[16:23] <Odd_Bloke> (Same issue as with A'scII y'day.)
[16:26] <Odd_Bloke> rharper: If we don't hear anything from them for a while, then we can work around it by opening a PR with their commits rebased; they wouldn't receive credit as the committer of the squash commit in that case, however.
[16:29] <Odd_Bloke> smoser: rharper: blackboxsw: If I could get a review of https://github.com/canonical/cloud-init/pull/643, we can unblock CI while I dig into the specifics of the LXD failure.
[16:30] <blackboxsw> grabbing that now thanks Odd_Bloke
[16:33] <smoser> oh, falcojr doesnt count
[16:33] <smoser> i saw his and left it
[16:34] <falcojr> haha, all my reviews are still pretend
[16:35] <blackboxsw> working towards it https://discourse.ubuntu.com/t/submitting-for-commit-rights-to-cloud-init/18770 :)
[16:36] <rharper> "latest lxd 4.7 snap causes failures"  when has lxd update not broken users?
[16:39] <smoser> ugh.
[16:39] <smoser>  https://github.com/canonical/cloud-init/pull/640
[16:39] <smoser> why dont' i see a "update branch" button
[16:39] <smoser> maybe AscII did not say "allow maintainers to update" or somethign ?
[16:39] <smoser> AscII: can you fetch && rebase ?
[16:39] <smoser> and push
[18:03] <AscII> smoser: i simply don't have that setting. Odd_Bloke guessed this might be because it's an organization repo
[18:04] <AscII> it might really be simpler if I delete the fork on the org repo and set up a new one in my own namespace
[18:07] <smoser> AscII: well i dont care too much either way
[18:07] <smoser> and really this should not be a problem.
[18:08] <AscII> anyway, it's rebased and you could merge it
[18:08] <blackboxsw> AscII: I think that might make sense, for future PRs, I see the mismatch between hetzneronline vs
[18:08] <blackboxsw> asciiprod. So pushes to your own remote may give you the permission to check the box that says "allow maintainer changes"  for this one off the rebase will/should work
[18:08] <blackboxsw> n/m too late
[18:09] <blackboxsw> n/m too late. as in, you already solved it.
[18:09] <meena> glad we solved that mystery
[18:10] <AscII> The PR is too embarrasing anyway. I should have doubled checked that before blindly adding the check
[18:10] <AscII> and voila, travis is happy too
[18:14] <smoser> AscII: landed.
[18:14] <Odd_Bloke> stgraber is fixing our lxd issue: https://github.com/lxc/lxd/pull/8102
[18:14] <smoser> AscII: well, to be fair to me (who requested the check) you would have just added a more subtle bug
[18:14] <smoser> which was sometimes metadata['instance-id'] would have been a integer, and sometimes a string.
[18:15] <blackboxsw> Woot! Odd_Bloke thanks!
[18:15] <AscII> you are right, that would have been an even bigger pain.
[18:16] <blackboxsw> smoser: rharper do either of you use https://github.com/cloud-init/qa-scripts/ repo anymore. We'd like to consolidate unused repos  (moving anything applicable into uss-tableflip.
[18:16] <blackboxsw> https://github.com/cloud-init/qa-scripts/issues/19
[18:18] <smoser> things that are there that i have used in the past 6 months:
[18:18] <blackboxsw> both public repos (we'll make sure no internal  jobs etc are using it), just didn't want to find out later about other consumers
[18:18] <smoser>  * get-propposed-cloudimg
[18:18] <smoser>  * lxc-proposed-snapshot
[18:18] <smoser>  - lxc-pstart
[18:19] <smoser> update-root
[18:19] <smoser> and those depend on psuedo-init i think
[18:22] <blackboxsw> thanks smoser, we'll tease out those dependencies and make sure to wrap up missing script dependencies. goal is to get applicable scripts/tools into  uss-tableflip/scrits
[18:22] <blackboxsw> *scripts
[18:22] <smoser> yeah. thats fine.
[18:24] <rharper> blackboxsw: same as smoser;  I think paride 's plan of merging bits into tableflip is fine
[18:24] <blackboxsw> good deal. thanks rharper
[19:13] <meena> https://github.com/canonical/cloud-init/pull/637 is ready to go
[20:57] <meena> (now)
[21:00] <meena> and so is https://github.com/canonical/cloud-init/pull/625 ( @ smoser )
[21:30] <danzarov> smoser, i tried a bunch of different ways but it didn't work :( maybe because i'm trying to use the ##template: jinja inside the AWS::EC2::LaunchTemplate UserData
[21:30] <danzarov> it doesnt seem to be interpreting the code
[21:32] <powersj> danzarov, are you base64 encoding your data?
[21:32] <danzarov> @powersj, yup :/
[21:32] <danzarov> it works, just the jinja code that doesn't
[21:33] <danzarov> https://stackoverflow.com/questions/42269785/error-when-parsing-yaml-file-found-character-that-cannot-start-any-token
[21:33] <danzarov> i did a very similar approach to the accepted answer here /\
[21:34] <danzarov> but seems that using # {% for x in anything %} is just interpreted as a comment, im not sure
[21:35] <powersj> yeah based on our docs I don't think you want to comment them: https://cloudinit.readthedocs.io/en/latest/topics/instancedata.html?highlight=jinja#using-instance-data
[21:35] <danzarov> i saw that one, im not using inside the runcmd: directive though
[21:35] <meena> (https://github.com/canonical/cloud-init/pull/622 also looks ready but needs another rebase)
[21:36] <danzarov> let me show you how im trying to do that @powersj, just a sec
[21:40] <danzarov> https://pastebin.com/TMsKWR69
[21:40] <danzarov> something like that
[21:40] <danzarov> but i dont think this is possible
[21:46] <powersj> blackboxsw, is it possible to use custom variables with cloud-init's jinja parsing? or is it limited to only variables exposed in /run/cloud-init/instance-data.json?
[22:01] <powersj> danzarov, fwiw I did get https://pastebin.ubuntu.com/p/KXhrDyC7w9/ to create alice and bob
[22:04] <powersj> the set line didn't seem to work when commented out as I got "Format for 'users' key must be a comma separated string or a dictionary or a list and not NoneType"
[22:04] <powersj> so it appeared to not resolve the list name
[22:05] <blackboxsw> powersj: no custom vars permitted by cloud-init proper jinja handling per the simplistic rendering of vars we do here https://github.com/canonical/cloud-init/blob/master/cloudinit/handlers/jinja_template.py#L81
[22:05] <powersj> and when uncommented I got Could not render jinja template variables
[22:05] <blackboxsw> extending that to add customized support would not be a "hard" if we have a feature bug etc
[22:06] <meena> a feature bug…
[22:06] <powersj> it's the featured bug of the week :P
[22:08] <powersj> danzarov, btw the way I was testing this was using lxd per https://cloudinit.readthedocs.io/en/latest/topics/faq.html#lxd
[22:08] <powersj> lol @ "btw the way"... maybe I should call it a week
[22:08] <meena> powersj  https://twitter.com/musha68k/status/1322299136167841796
[22:09] <powersj> hahaha
[22:09] <danzarov> @powersj, that's interesting, gonna test it on my environment
[22:10] <danzarov> did the alice and bob example worked?
[22:14] <powersj> danzarov, https://pastebin.ubuntu.com/p/xcfCJNpJNF/
[22:14] <danzarov> woah
[22:14] <danzarov> nice!
[22:15] <danzarov> im spinning up a cluster here, gonna test inside the UserData
[22:15] <danzarov> lets see how it goes
[22:21] <blackboxsw> danzarov: powersj if something goes awry and you instance doesn't look like it got setup properly, you can quickly inspect the rendered userdata on the instance with `sudo cloud-init query --format="$(cloud-init query userdata)"`
[22:21] <blackboxsw> what the above cmd does is `cloud-init query userdata` report the raw userdata template you provided to the instance at launch.
[22:21] <danzarov> thats good, will be very useful
[22:21] <danzarov> thanks
[22:22] <powersj> that is a good one blackboxsw we should add that to the docs page for jinja
[22:22] <blackboxsw> the `cloud-init query --format` wrapper will render the jinja template content and try performing your loop to see ultimately how the final  #cloud-config looked with vars rendered loops iterated
[22:22] <blackboxsw> yeah will add that now
[22:22] <blackboxsw> just came up with it as I hadn't thought of a non-lxd way to iterate quickly on this
[22:23] <blackboxsw> danzarov: feature-wise you were looking initially to support rendering,reacting to the host underlying environment variables in jinja templates?
[22:24] <blackboxsw> like whether an image or environement could expose an environment variable that cloud-init's jinja template could react to?
[22:24] <blackboxsw> I ask as powersj alluded to "custom variables with cloud-init's jinja parsing"
[22:24] <powersj> blackboxsw, https://pastebin.com/TMsKWR69 that was what danzarov was trying to do
[22:25] <blackboxsw> I like the idea of augmenting the stock vars that are available to cloud-init's jinja templates,
[22:25] <blackboxsw> right where names were hardcoded in the user-data though  {% set list1 = ['name1', 'name2'] %}
[22:25] <danzarov> hrmm got this
[22:25] <danzarov> Oct 30 22:20:58 cloud-init[3577]: util.py[WARNING]: Failed loading yaml blob. Invalid format at line 8 column 4: "while scanning for the next token
[22:25] <danzarov> found character '%' that cannot start any token
[22:25] <danzarov>   in "<string>", line 8, column 4:
[22:25] <danzarov>       {% for name in ["alice", "bob"] - ...
[22:25] <danzarov>        ^"
[22:26] <danzarov> ops, sorry multiple lines
[22:26] <blackboxsw> I was wondering about whether there were a need to have a {% set userlist = env['CUSTOM_USERS'] %} type facility
[22:26] <blackboxsw> as right now we limit cloud-init template vars to just instance-data.json
[22:27] <blackboxsw> it would be a nice facility to allow augmenting those template vars
[22:27] <danzarov> @blackboxsw, actually i did that just to illustrate, what im doing in reallity is seting the userlist variable with a list comming from terraform cloudformation stack parameters
[22:27] <danzarov> so i basically assigned userlist with this list of usernames comming from terraform
[22:28] <danzarov> and i want to loop like @powersj did
[22:28] <danzarov> but i got this error, i wonder if this is specific to UserData in aws launchtemplate UserData
[22:28] <danzarov> weird
[22:28] <blackboxsw> as a note, any variables exposed by the metadata service gets cached in cloud-init's instance data and a `cloud-init query --all` can list any available keys/data from that datasource under the 'ds' key
[22:29] <blackboxsw> so if there are ways for you to expose terraform stack params via the datasource,then cloud-init jinja templates pick up on that
[22:29] <danzarov> humm i saw something interesting using the command you mentioned above
[22:29] <danzarov> sudo cloud-init query --format="$(cloud-init query userdata)"
[22:29] <danzarov> WARNING: Ignoring jinja template for query commandline: 'tuple object' has no attribute 'split'
[22:30] <danzarov> got this
[22:30] <danzarov> oh i didnt know about the ds key
[22:30] <blackboxsw> ok so back out to `sudo cloud-init query userdata`
[22:31] <blackboxsw> you'll need to be running as root user for all query commands using userdata. so the call should actually be `cloud-init query --format="$(sudo cloud-init query userdata)"
[22:31] <danzarov> oh wait, i left a mistake on my code that can be causing the problem
[22:31] <danzarov>   # {% set list1 = var.split(',') %}
[22:31]  * powersj disappers
[22:32] <danzarov> lmao
[22:32] <danzarov> let me remove this and try again
[22:35] <danzarov> btw i was doing this split because i had to pass a string like username = 'user1,user2,user3'. because cloudformation stack resource doesnt support passing a list
[22:35] <danzarov> :|
[22:43] <danzarov> hmm weird, same error as above
[22:43] <danzarov> found character '%' that cannot start any token
[23:10] <blackboxsw> drive by doc pr  https://github.com/canonical/cloud-init/pull/645/files
[23:10] <blackboxsw> <- dinner run. have a good one folks
[23:10] <danzarov> cya
[23:10] <danzarov> thanks for the help
[23:32] <danzarov> blackboxsw, powersj you guys rock! it worked (((:
[23:33] <danzarov> i had some indentation problem after that code, sorry didnt notice at first